REP ORT RESUMES 

ED 020 297 za ud ocs sre 

A CONTINUATION OF THE CRAFT PROJECT COMPARING READING 
APPROACHES WITH DISADVANTAGED URBAN NEGRO CHILDREN IN PRIMARY 
GRADES. FINAL REPORT. 

BY- HARRISi ALBERT J. AND OTHERS 

CITY UNIV. OF NEW YORKi DIV. OF TEACHER EDUCATION 

REPORT NUMBER BR-5-0570 PUB BATE JAN 68 

CONTRACT OEC-6-10-063 

EDRS PRICE MF-$1.50 HC-$15.72 391P. 

DESCRIPTORS- «NEGRO STUDENTSi ^PRIMARY GRADESi ^i^READING 
INSTRUCTION, >i«READING RESEARCH, 4:READING ACHIEVEMENT, URBAN 
YOUTH, DISADVANTAGED YOUTH, READING TESTS, SEX DIFFERENCES, 
TEACHER CHARACTERISTICS, TABLES (DATA), STATISTICAL ANALYSIS, 
MEASUREMENT INSTRUMENTS, LANGUAGE EXPERIENCE APPROACH, 
AUDIOVISUAL INSTRUCTION, READING SKILLS, PHONICSi EARLY 
READING, METROPOLITAN ACHIEVEMENT TESTS, CRAFT PROJECT, NEW 
YORK CITY 

THIS EXTENSIVE REPORT DESCRIBES THE CONTINUATION OF A 
PROJECT WHICH INVESTIGATED THE READING PROGRESS OF 
DISADVANTAGED URBAN NEGRO CHILDREN FROM FIRST THROUGH THIRD 
GRADE USING TWO BASIC TEACHING APPROACHES. THE PROJECT 
OPERATED IN TWELVE NEW YORK CITY PUBLIC ELEMENTARY SCHOOLS. 
SPECIFICALLY DESCRIBED ARE THE SECOND-GRADE CONTINUATION 
PROCEDURES, THE THIRD-GRADE FOLLOWUP STUDY, AND A SMALLER 
SCALE REPLICATION STUDY IN THE FIRST AND SECOND GRADES. THE 
EXPERIMENTAL TEACHING TECHNIQUES WERE (1) THE SKI LLS-CENTEREB 
APPROACH, WHICH INCLUDED A BASAL READER METHOD AND A 
PHONOVISUAL METHOD, AND (2) THE LANGUAGE-EXPERIENCE APPROACH 
IN WHICH READING MATERIALS WERE DEVELOPED FROM THE 
EXPERIENCES AND VERBALIZATIONS OF THE CHILDREN. THE SECOND 
. APPROACH WAS SUPPLEMENTED BY AN AUDIOVISUAL METH'OD. IN THE 
REPLICATION STUDY, AN ADDITIONAL "PILOT” METHOD WAS USED 
WHICH COMBINED FEATURES OF ALL THE METHODS. RELATED VARIABLES 
SUCH AS SEX DIFFERENCES, KINDERGARTEN EFFECTS, EFFECT OF 
EARLY READING, AND TEACHER CHARACTERISTICS WERE ALSO STUDIED. 
APPENDIXES CONTAIN SOME MEASUREMENT INSTRUMENTS AND EXTENSIVE 
STATISTICAL TABLES. (LB) 




.1 



o> 

rv/ 







o 




LU 



,■ in 



»/ 



FINAL REPOjy^ 

Project No. 5-0570-2-12-1 
Contract No. OE 6-10-063 
January, 1968 



A 



A CONTINUATION OF THE CRAFT PROJECT 

Comparing Reading Approaches 

with 

Disadvantaged Urban Negro Children 
in Primary Grades 




U.S. DEPARTMENT OF 
HEALTH, EDUCATION, AND WELFARE 

Office of Education 
Bureau of Research 



UO OH S^f 



A CONTINUATION OF THE CRAFT PROJECT 
Comparing Reading Approaches with Disadvantaged 
Urban Negro Children In Primary Grades 



Project No. 5-0570-2-12-1 
Contract No. OE 6-10-063 



Albert J. Harris 
Coleman Morrison 
Blanche L. Server 
Lawrence Gold 



January, 1968 



The research reported herein was perf^ormed pursuant to a contract 
with the Office of Education, U.S. Department of Health, Education, 
and Welfare. Contractors undertaking such projects under Government 
sponsorship are encouraged to express freely their professional 
judgment In the conduct of the project. Points of view or opinions 
stated do not, therefore, necessarily represent official Office of 
Education position or policy. 



Division of Teacher Education 
The City University of New York 
New York, New York 



U.S. DEPARTMEHT GF HEALTH, EDUCATION & WELFARE 
OFFICE OF EDUCATION 



THIS DOCUMENT HAS BEEN REPRODUCED EXACTLY AS RECEIVED FROM THE 
PERSON OR 0R6ANIZATI0N ORIGINATING IT. POINTS OF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRESENT OFFICIAL OFFICE OF EDUCATION 
POSITION OR POLICY. . . 












I ERiC 



Foreword and Acknowledgments 



The CRAFT Project was an ambitious effort to study the effec~ 
tlveness of different ways of teaching reading to disadvantaged 
urban Negro children. It Involved a three-year study of a popula- 
tion of over 1,300 children, and a replication for two years with 
over 600 children. 

The project was made possible. by a contract from the U.S. 

Office of Education for 1964-66, and the continuation study report- 
ed herein was made possible by a second U.S.O.E. contract for an 
additional two and a half years, 1966-68. In addition to federal 
support, the project received many kinds of assistance from the 
Board of Education of the City of New York, and from the Division 
of Teacher Education of The City University of New York. For this 
support we are all very grateful. 

The project has been dependent on so many people that It Is 
Impossible to express In any adequate fashion the gratitude that so 
many have earned. They are listed below, and each one contributed 
usefully to the project. Yet, It Is Impossible not to give special 
thanks to Mrs. Helene M. Lloyd, Assistant Superintendent of Schools, 
who marshalled support at all levels within the Board of Education, 
and to Dr. Harry N. Rlvlln, who as Dean of Teacher Education during 
the first two years, provided wise guidance and unfailing support 
through financial and other difficulties. 

The undersigned Initially selected the variables to be studied, 
has made the major administrative decisions, and accepts responsi- 
bility for any errors that may have Inadvertently occurred either In 
the project operations or In the analysis and Interpretations of the 
data. The assistant directors (Drs. Serwer, Gold, and Morrison) 
skillfully guided the ongoing operations and concur In the conclu- 
sions which they have helped to shape. This report has been a joint 
effort which contains words as well as Ideas of the four of us. 

A few people have been particularly helpful In the production of 
the report. Thus, we want to thank Irma-Theresa Auerbach for her con- 
stant striving for accuracy; Genaro Lachlca for verifying the statis- 
tical Interpretations; Priscilla Pereira for stylistic editing and 
proofreading; Adelaide Shields for resourceful management of manu- 
script producticm; Selma Miller, for typing most of the tables; Mary 
Kavanaugh for typing most of the text; and our research assistants, 
who have cheerfully plowed through thousands of details. 

To them, and to all the other participants each of whom was essen- 
tial, we extend our heartfelt thanks. 



Albert J. Harris 
January, 1968 



PROJECT PERSONNEL 



Executive Advisory Committee 



Dr, Harry N, Rivlin, Dean of Teacher Education, The City University 
. of New York (1964-66) 

Dr. Harold H. Abelson, Acting Dean of Teacher Education, The City 

University of New York (1966-67) 

Dr. Benjamin Rosner, University Dean of Teacher Education, The City 

University of New York (1967-68) 

Dr. W. Virgil Nestrick, Associate Dean of Teacher Education, The City 

University of New York (1964-66) 

Dr. John B. King, Deputy Superintendent, Board of Education of the 

City of New York (1964-66) 

Dr. Joseph 0. Loretan, Deputy Superintendent, Board of Education of 

the City of New York (1964-67) 

Miss Truda T. Weil, Assistant Superintendent, Elementary Division, 

Board of Education of the City of New York 
(1964-68) 

Dr. J. Wayne Wrlghtstone, Assistant Superintendent for Research, Board 

of Education of the City of New York (1964-68) 

Mrs. Helene M. Lloyd, Assistant Superintendent, Board of Education of 

the City of New York (1964-68) 



Advisory Committee 



Dr. J. Wayne Wrlghtstone, Assistant Superintendent for Research, Board 

of Education of the City of New York (1964-68) 

Mrs. Helene M. Lloyd, Assistant Superintendent, Board of Education of 

the City of New York (1964-68) 

Dr. Samuel D. McClelland, Acting Director, Bureau of Educational Research, 

Board of Education of the City of New York (1964-68) 
Dr. Joseph Justman, Acting Director, Bureau of Educational Program Re- 
search and Statistics, Board of Education of the 
City of New York (1964-67) 

Dr. Edward G. Bernard, Director, Audio-Visual Instruction, Board of Edu- 
cation of the City of New York (1964-68) 

Mrs. Rebecca Wlnton, Director, Early Childhood Education, Board of Educa- 
tion of the City of New York (1964-68) 

Dr. William Rablnowitz, Associate Professor of Education, The City Uni- 
versity of New York (1964-65) 



District Superintendents 

Miss Margaret K. Bible, District 28, Queens (1965-67) 
Mr. Maurice Mehlman, District 27, Brooklyn (1964-67) 



o 



iii 



District Superintendents (cont . ) 



Mrs. Elizabeth O'Daly, District 32, Brooklyn (June to September 1964) 
Dr. Sidney Rosenberg, District 13, Manhattan (1964-67) 

Mr. Max Rubensteln, District 29, Queens (1965-67) 

Dr. Louise Ryan, District 50, Queens (1964-65) 

Mrs. Rose Schwab, District 27, Queens (1965-67) 

Dr. Charles Shapp, District 13, Manhattan (June to September 1964) 

Dr. Abraham Tauchner, District 32, Brooklyn (1964-67) 



School Principals 



Mrs. Sarah Addelsteln, P.S. 136, Queens.. (1965-67) 

Dr. Samuel Altman, P.S. 305, Brooklyn (1964-67) 

Mr. Jesse Barbash, P.S. 136, Queens (1964-65) 

Mr. Carl Berg, P.S. 309, Brooklyn (1964-65) 

Dr. Lee Cottrell, P.S. 186, Manhattan (1964-67) 

Miss Catherine Dooley, P.S. 116, Queens (1964-67) 

Mr. Philip Flnkelsteln, P.S. 28, Brooklyn (1965-67) 

Mr. Erwin Kaufman, P.S. 123, Manhattan (1964-67) 

Mr. Emmanuel Loeb, P.S. 28, Brooklyn (1964-65) 

Mr. Julius Nislow, P.S. 93, Brooklyn (1964-67) 

Mr. Eugene Roberts, P.S. 160, Queens (1964-67) 

Mr. Marvin Schwartz, P.S. 45, Queens (1964-67) 

Mrs. Eudlce Gansberg Stadlen, P.S. 44, Brooklyn (1964-66) 
Mr. Carl Toporoff, P.S. 137 and 40, Brooklyn (1964-67) 



Assistant Principals 

Nrs, Estelle Abrahamson, P.S. 123, Manhattan (1967) 

Mr. Robert Berger, P.S. 305, Brooklyn (1964-66) 

Mrs. Anne Broude, P.S. 186, Manhattan (1964-66) 

Mr. Stanley Cantor, P.S. 305, Brooklyn (1964-67) 

Mrs. Vernella D'Arbeau, P.S. 123, Manhattan (1964-65) 

Mr. Ellas Emanuel, P.S. 93, Brooklyn (1964-67) 

Mr. Seymour Friedman P.S. 137 and 40, Brooklyn (1964-67) 
Mrs. Sylvia Friedman, P.S. 309, Brooklyn (1964-65) 

Miss Ceclle Graves, P.S* 28, Brooklyn (1964-66) 

Mr. William Landers, P.S. 123, Manhattan (1965-66) 

Mr. Robert Lauer, P.S. 28, Brooklyn (1966-67) 

Mr. Bernard Lena^n, P.S. 116, Queens (1964-67) 

Mrs. Elsie McNeil, P.S. 160, Queens (1964-66) 

Mrs. Hazel Schrelber, P.S. 160, Queens (1964-66) 

Mr. Samuel Solow, P.S. 44, Brooklyn (1964-66) 

Mrs. Sylvia Tosonl, P.S. 186, Manhattan (1966-67) 

Mr. Harry Welntraub, P,,S. 136, Queens (1964-67) 

Mr. Lawrence Wolsky, P.S. 45, Queens (1964-67) 



School Consultants 



Reading Consultants 

Mrs. Evelyn Farrar, District 13, Manhattan (1964-67) 
Mrs. Anne Goldstein, District 27, Brooklyn (1964-67) 
Mrs. Alma Kelly, District 32, Brooklyn (1964-67) 
Miss Ruth Lavin, District 50, Queens (1964-67) 

Mrs. Anne Smith, District 27, Brooklyn (1967) 

Miss Paula Zajan, District 13, Manhattan (1967) 



Early Childhood Consultant 
Miss Paula Zajan (1964-66) 



Liaison Consultant, Elementary Division 
Miss Mary Sendek (1964-65) 

Audio-Visual Consultants 

Mr. Stanley Leibman (1964-65) 

Mr. Philip Lewis (1965) 

Mr. Joseph Millman (1966-67) 



Second Grade Teachers - ContJ-nuation Study 1965-66 



Miss Rose Berger’^ 

Mrs. Lorraine Bragin’^ 

Miss Judith A. Cohen 
Mrs. Yurlko Duggan’^ 

Miss Frieda Flescher^fc 
Mrs. Cora Miles Gibson’^ 

Miss Susan Glick 
Mrs. Audrey E. Harris 
Miss Anne Hendlln 
Mrs. Marilyn Hirschhorn* 

Mrs. Frieda Horn 
Mrs. Katie E. Jackson’^ 

Miss Wllhelmina F. Jenkins’^ 

Mrs. Alta Kallbala’^ 

Miss Lillian Kastel 
Miss Pearl Katz’^ 

Mrs. Esther Klausner^^ 

Miss Linda S. Kramer 

Mrs. Adrienne Tragash Lifschltz 

Mrs. Harriet Linton 

Mrs. Edith Lltt 

Mrs. Bessie Marks’^ 



*Also in Replication, Grade II 



Mrs. Irma Mason’^ 

Mrs. Anna Masters’^ 

Miss Laura Mlckens’^ 

Mrs. Ronnie S. Miller 
Mrs. Elizabeth Nicholson* 

Mrs. Anita Ratener* 

Mrs. Diane Berman Reinhardt 
Miss Elaine! Relsman 
Mrs. Zelda Ross* 

Mrs. Maxine Schackman 
Mrs. Barbara Schneider* 

Mrs. Laura Silverman* 

Mrs. Irene F. Spiller* 

Mrs. Joan Morales Stangel* 

Miss Carolyn Steele 
Mrs. Margaret Sylvester* 

Mrs. Rose Tangredl 
Mrs. C. Mae Terry 
Mrs. Deanna Turner Jordan 
Mrs. Mabel Whiteman* 

Miss Adell Whitney* 

Mrs. Fanny W. Bond replaced 
Mrs. Schneider in the 
second half of replication 



V 



First Grade - Replication Teachers 



Miss Abigail Ain 

Miss Esther Anker 

Miss Mary Atherley 

Mrs. Marsha Beyda 

Mrs. Ida Blakeman 

Miss Julienne Brennan 

Mrs. Clarice Brown 

Miss Elsie DeSandles 

Miss Edna M. Egan 

Mrs. Arlene Bergman Goldberg 

Miss Doris Goldenberg 

Mrs. Millie Greenberg 

Miss Anita Grosnas 

M1<'>s Doris Helda 

Mrs. Rhoda Isaacson 

Miss Wllhelmlna F. Jenkins 



Mrs. Lesley Rose Kantor 
Mrs. Marcia Beck Loner 
Miss Catherine M. McEvoy 
Mrs. Ann Morris 
Mrs. Georgia Parker 
Miss Rosemary Parker 
Mrs. Paula Kaplan Prlzant 
Miss Susan Schoenthal 
Mrs. Linda Elsenberg Seeman 
Mrs. Gall Friedman Simon 
Mrs. Sylvia E. Taylor 
Miss Helen Weiss 
Mrs. Elsie Wilkin 
Miss Barbara Ye Howl tz 
Mrs. Ruth Younger 



Research Staff 



Director; Dr. Albert J. Harris (1964-68) 



Asst. Directors: 



Dr. Blanche L. Serwer (1964-66) 
Dr. Lawrence Gold (1966-67) 

Dr. Coleman Morrison (1967-68) 



Lecturers ; Mrs. Lou Hicks Smith (1964-65) 

Mrs. Barbara Heller (1966-67) 

Miss Irma-Theresa Auerbach (1967-68) 



Research Assistants ; Mr. Lawrence J. Deutsch (1964-65) 

Mr. Kenneth M. Brelesky (1964-66) 
Miss Sharon Geier (1964-65) 

Mr. James Goggln (1964-65) 

Miss Aliki Porihi (1964-67) 

Mr. Paul Ross (1965-66) 

Mrs. Raquel Teitel (1965-66) 

Miss Irma-Theresa Auerbach (1966-67) 
Miss Frieda Kurash (1967) 

Miss Mary Liu (1967) 

Mr. Sheldon Weill (1966-67) 

Miss Roberta Hlrshfleld (1967-68) 
Miss Simone Arons (1967-68) 

Miss Sallle Bregman (1967-68) 

Mr. Gary N. McLean (1967-68) 



Consultants on Research Design and Statistics : 



Statistical 



Secretaries 



Dr. Donald M. Medley (1964-68) 

Dr, Eve Malmquist (1965) 

Dr, Benjamin Wright (1965-67) 

Dr, Maurice Lohman (1965-68) 

Staff : Mr, Genaro Lachica, Statistician (1965-6J 

Mr, Paul Barbuto, Programmer (1965-66) 
Mrs. Marianne Williams, Programmer (1966* 



Mrs. Diana Kee (1964) 

Mrs. Selma S. Miller (1965-68) 



vii 



TABLE OF CONTENTS 



CHAPTER PAGE 

I INTRODUCTION 1 

1. First Year of the CRAFT Project 3 

2. The Rationale for Continuation 10 

3. Plan of the Continuation Study 12 

4 . The Rationale for Replication 13 

5. Plan of the Replication Study 13 

6. Objectives 14 

II RELATED RESEARCH 18 

1. Readiness for the Disadvantaged 19 

2. Beginning Reading Instruction for the 

Disadvantaged 20 

3. Cooperative Studies in the Second Grade 25 

III SECOND GRADE CONTINUATION PROCEDURES 26 

1. The Schools 26 

2. The Pupils 27 

3. The Teachers 29 

4. The Program for the Year 30 

5. Measurement and Evaluation procedures 31 

6 . Eicperlmenta^LH^ecautlons 39 

IV METHODS OF INSTRUCTION IN T^ SECOND GRADE 42 

1. Description of Teaching Methods 42 

2. Teacher Training Program * 51 

3. The Role of the School Principal 52 

V SECOND GRADE CONTINUATION RESULTS 55 

1. CRAFT and Non-CRAFT Children 55 

2. Results for the Total CRAFT 2 Population 56 

3. The Subsampie Results 61 

4. Comparison of Boys and Girls 65 

5. Comparison of Kindergarten and Non-Kindergarten 

Children 66 

6. Results for Early Readers 68 

7. Analysis of Teachers 'Use of Time as Revealed 

by Dally Logs 71 

8. Analysis of the Results of OScAR R 76 

9. The San Diego Teacher Inventory of Approaches 

to the Teaching of Reading 79 

10. Other Variables 82 



viii 



o 






TABLE OF CONTENTS (continued) 

CHAPTER page 

VI THE THIRD GRADE POLLOW-UP 84 

1. Procedures for CRAFT 3 84 

2. Pretest Results 88 

3. Group I Results 89 

4. Results for Group II 96 

5. Results for Group III 97 

VII THE FIRST-GRADE REPLICATION 100 

1. First-Grade Replication Procedures 100 

2. Pretest and Posttest Results 103 

3. Teacher Variables 108 

4. Other Variables 110 

VIII THE SECOND-GRADE REPLICATION 112 

1. Replication 2 Procedures 112 

2. Replication 2 Results for the Total Population 115 

3. Relation of Teacher Variables to Outcomes 125 

IX DISCUSSION, CONCLUSIONS, AND RECOMMENDATIONS 128 

1. Achievement of the Total Experimental Population 128 

2. Comparison of CRAFT with Non-CRAFT Children 129 

3. Comparison of Approaches and Methods 130 

4. Achievement of Special Groups 134 

5. Instructional Time 136 

6. Other Teacher Variables 138 

7. Other Variables 140 

8. Some Limitations 141 

9. Recommendations 143 

X SUMMARY 145 

1 , Procedures 145 

2 . Results 147 

REFERENCES 151 

APPENDIX A: Statistical Tables 154 

APPENDIX B: Forms 343 

Instructions for Administration of Writing 

Sample Story 344 

Directions for Dally Log Form 345 

Copy of Dally Log Form 346 

Rating Scale of Teacher's Attitude Towards 

CRAFT Method 347 

Directions for Individual Reading Record 350 

Second Grade Reading Interest Scale 351 



lx 



TABLE OF CONTENTS (continued) 









CHAPTER 



PAGE 



An Inventory of Reading Attitude (San Diego) 352 

CRAFT Word Recognition Test 35^ 

Instructions for Recording Behavior with OScAR R 355 
ERIC REPORT RESUME 367 



X 



LIST OF TABLES 

Table Page 

1.1 Adjusted Grade Score Means for Full-Session 

Classes, CRAFT 1 9 

3.1 Assignment of Methods to CRAFT 2 Classes 155 

3.2 Pupil Loss by School and Borough from Beginning 

of CRAFT 1 Through the End of CRAFT 2 156 

3.3 Pupil Loss by School and Borough from CRAFT 1 

Posttests Through CRAFT 2 Post tests 157 

3.4 Per Cent of CRAFT 1 Children in CRAFT 2 Classes 

by Method and Approach 158 

3.5 CRAFT 1 Pretests and Posttests for the Final. 

Population in CRAFT 2 Compared with the Final 
Population of CRAFT 1 159 

3.6 CRAFT 2 Class Size as of May, 1966 160 

3.7 CRAFT and Non-CRAFT Children in the CRAFT 2 

Classes Who Took the Posttests 161 

3.8 Number of Boys and Girls in CRAFT 2 162 

3.9 Age of Teachers in CRAFT 2 162 

3.10 Educational Level of the CRAFT 2 Teachers 163 

3.11 Total Years of Teaching Experience, CRAFT 2 163 

3.12 Second Grade Teaching Experience, CRAFT 2 164 

5.1 Comparison of MAT Raw Scores for CRAFT and Non- 
CRAFT Children in the Same Classes, CRAFT 2 

(Class as Unit) 165 

5.2 Comparison of Obtained MAT Mean Grade Equivalents 
for CRAFT and Non-CRAFT Children In Same Classes, 

CRAFT 2 166 

5.3 Raw Score Results for MAT Posttests, CRAFT 2 

(Class as Unit) 167 

5.4 Obtained Grade Equivalent Means for MAT Posttests, 

CRAFT 2 (Class is Unit) 168 

xi 



LIST OF TABLES (cont.) 



Table Page 

5.5 Correlation Matrix of CRAFT 1 Pretests and 

Posttests and CRAFT 2 Posttests 169 

5.6 Regression Equations for MAT Scores Predicted 

by First Grade Pretests, CRAFT 2 170 

5.7 Regression Equations for MAT Scores Predicted 

by First Grade Posttests, CRAFT 2 171 

5.8 MAT Posttest Results Adjusted by First Grade 

Pretests, CRAFT 2 (Class as Unit) 172 

5.9 MAT Post test Results Adjusted by First Grade 

Posttests, CRAFT 2 (Class as Unit) 173 

5.10 Grade Equivalents for MAT Posttests Adjusted by 

First Grade Pretests, CRAFT 2 (Class as Unit) 174 

5.11 Grade Equivalents for MAT Posttests Adjusted by 

Posttests, CRAFT 2 (Class as Unit) 175 

5.12 Significant _t Comparisons between Methods on MAT 

Posttests, CRAFT 2 (Class as Unit) 176 

5.13 Range of Raw Score Class Means for Grade Equiva- 
lents for MAT Posttests, CRAFT 2 (Class as Unit) 177 

5.14 Range of Class Means and Grade Equivalents for 
MAT Posttests Adjusted by First Grade Pretests, 

CRAFT 2 (Class as Unit) 178 

5.15 Range of Class Means and Grade Equivalents for 
MAT Posttests Adjusted by First Grade Posttests, 

CRAFT 2 (Class as Unit) 179 

5.16 Analysis of Variance: Comparison of Approaches 
for MAT Word Discrimination Adjusted by First 

Grade Pretests, CRAFT 2 (Class as Unit) 180 

5.17 Analysis of Variance: Comparison of Approaches 
for MAT Word Discrimination Adjusted by First 
Grade Pretests Controlling for School Effects, 

CRAFT 2 (Class as Unit) 180 

5.18 Analysis of Variance: Comparison of Methods for 

MAT Word Discrimination Adjusted by First Grade 
Pretests, CRAFT 2 (Class as Unit) 181 

xii 



LIST OF T.^7.ES (cont.) 



Table Page 

5.19 Analysis of Variance: Comparison of Approaches for. 

MAT Word Discrimination Adjusted by First Grade \ 
Pretests, CRAFT 2 (Split Session Schools Deleted) \ 

(Class as Unit) \ 182 

5.20 Analysis of Variance: Comparison of Approaches for 

MAT Word Discrimination Adjusted by First Grade 
Pretests Controlling for School Effects, CRAFT 2 182 

5.21 Analysis of Variance: Comparison of Methods for 
MAT Word Discrimination Adjusted by First Grade 
Pretests, CRAFT 2 (Split Session Schools Deleted) 

(Class as Unit) 183 

5.22 Number of Books Read Completely, Partially, and 

Teachers* Evaluation of Eagerness to Read and 
Maturity of Choices, CRAFT 2 (Class as Unit) 184 

5.23 San Diego Pupil Attitude Inventory, CRAFT 2 

(Child as Unit) 185 

5.24 Comparison of Subsample Children to the Entire 

Population on the MAT Posttests, CRAFT 2 185 

5.25 Correlations betv^een First Grade Pretests and 

Second Grade Subsample Tests (Child as Unit) 186 

5.26 Obtained Results for Subsaraple Measures, CRAFT 2 

(Child as Unit) 187 

5.27 Subsample Measures Adjusted by First Grade Pre- 

Tests, CRAFT 2 (Child as Unit) 188 

5.28 Subsample Measures Adjusted by First Grade Pre- 

Tests, CRAFT 2 (Class as Unit) 189 

5.29 Grade Equivalent Means on the Gilmore Accuracy and 

Gates Word Pronunciation Tests, CRAFT 2 190 

5.30 ^Values for Adjusted Means on the Individual Tests, 

CRAFT 2 (Child as Unit) 191 

5.31 Analysis of Variance: Fry Test Adjusted by First 

Grade Pretests Across All Schools, CRAFT 2 192 

xiii 



LIST OF TABLES (cont.) 



Table 

5.32 

5.33 

5.34 

5.35 

5.36 

5.37 

5.38 

5.39 

5.40 

5.41 

5.42 

5.43 



Analysis of Variance: Fry Test Score Adjusted 
by First-Grade Pretests Controlling for School 
Effects, CRAFT 2 

Analysis of Variance: Fry Test Adjusted by 
First-Grade Pretests for Different Pairings of 
Methods, CRAFT 2 

Analysis of Variance: Polysyllabic Word Score 
Adjusted by First-Grade Pretests Across All 
Schools, CRAFT 2 

Analysis of Variance: Polysyllabic Word Score 
Adjusted by First-Grade Pretests Controlling for 
School Effects CRAFT 2 

Analysis of Variance: Polysyllabic Word Score 
Adjusted by First-Grade Pretests for Different 
Pairings of Methods, CRAFT 2 

Comparison of Boys and Girls on ^T Raw Scores by 
Method, CRAFT 2 (Child as Unit) 

Comparison of Boys and Girls on MAT Posttests 
Adjusted by First-Grade Posttests, CRAFT 2 
(Child as Unit) 

Pre-First-Grade School Experience, CRAFT 2 

Raw Score Stanford Posttest Results of Children 
with and without Full Kindergarten Experience, 

CRAFT 2 (Child as Unit) 

Mean Grade Equivalents on Stanford POsttests of 
Children with and without Full Kindergarten Ex- 
perience, CRAFT 2 (Child as Unit) 

Results of Metropolitan Posttests for Children with 
and without Full Kindergarten Experience, CRAFT 2 
(Child as Unit) 

Mean Grade Equivalents on MAT Posttests for Child- 
ren with and without kindergarten Experience, 

CRAFT 2 (Child as Unit) 

xiv 



Page 

192 

193 

194 

194 

195 

196 

197 

198 

199 

200 
201 
202 






LIST OF TABLES (cont.) 



Table Page 

5.44 Early Readers Compared to Total Population on 

First-Grade Pretests and Posttests, CRAFT 2 203 

5.45 Early Readers Compared to Total Population In 

the Language-Experience Approach on First-Grade 
Pretests and Posttests, CRAFT 1 204 

5.46 Early Readers Compared to Total Population In 
the Skills -Centered Approach on First-Grade 

Pretests and Posttests, CRAFT 1 205 

5.47 Comparison of Early Readers in the Two Approaches 

on First-Grade Pretests and Posttests, CRAFT 1 206 

5.48 Mean Grade Equivalents for Early Readers and Total 
Population on First-Grade Stanford Posttest, 

CRAFT 1 207 

5.49 Mean Grade Equivalents for Early Readers on First- 

Grade Stanford Posttest by Approach, CRAFT 1 207 

5 . 50 Comparison of Early Readers in the Two Approaches 
on Second-Grade Metropolitan Achievement Tests, 

CRAFT 2 208 

5.50A Comparison of Early Readers and Total Population on 
Second-Grade Metropolitan Achievement Tests, 

CRAFT 2 209 

5.51 Mean Grade Equivalents for Early Readers on Second- 
Grade Metropolitan Achievement Tests by Approach, 

CRAFT 2 210 

5.52 Early Readers Compared to Total CRAFT Population 

on Second-Grade MAT Posttests 211 

5.53 Mean Dally Time in Minutes for Reading Activities 

and Supportive Activities, CRAFT 2 (Class as Unit) 212 

5.54 Mean Minutes Per Day Spent on Specific Reading and 

Supportive Activities, CRAFT 2 (Class as Unit) 213 

5.55 Correlations of 73 Variables with MAT Adjusted 

Class i!<^.ans, CRAFT 2 214 



XV 



LIST OF TABLES (cont.) 



Table Page 

5.56 Mean Minutes Per Day Spent for Reading Activities 

Correlated with the MAT Sub tests, CRAFT 2 216 

5.57 Correlations of Minutes Per Day Spent on Reading 

and Supportive Activities with MAT Reading and 
Word Knowledge Scores Adjusted by First-Grade Post- 
tests, CRAFT 2 (Class as Unit) 217 

5.58 Correlations of OScAR R Variables and Adjusted 
Stanford Word Knowledge and Paragraph Meaning, 

CRAFT 1 218 

5.59 Means and Standard Deviations of 74 Variables for 

the Four Methods and Total, CRAFT 2 219 

5.60 Comparisons between Methods on OScAR R Scales, 

CRAFT 2 222 

5.61 Correlations of OScAR R Variables with MAT Word 
Knowledge and Reading Sub tests Adjusted by First- 

Grade Posttests, CRAFT 2 223 

5.62 ^ Comparisons of Second-Grade Teachers on the 

San Diego Pretests and Posttests, CRAFT 2 224 

5.63 Significant t Comparisons between Methods on the 

San Diego Teacher Inventory Pretest, CRAFT 2 225 

5.64 Means and Standard Deviations for Significant Jt 
Comparisons between Methods on the San Diego 

Teacher Inventory Post tests, CRAFT 2 226 

6.1 Pupil Loss by School and Borough from the Begin- 
ning of First Grade through the End of Third Grade, 

CRAFT 3 227 

6.2 Pupils' School Location by Method, CRAFT 3 228 

6.3 Distribution of Total Population by Group and 

Grade Placement, CRAFT 3 229 

6.4 First-Grade Pretests for Children with First 

through Third-Grade Data 230 

6.5 First-Grade Pretests for Children with only First 
and Third-Grade Data 

3CVl 



231 




LIST OF TABLES (cont.) 

Page 

232 

233 

234 

235 

238 

239 

92 

240 

241 

242 

243 

244 

245 

246 

247 



xvii 




Table 

6.6 First-Grade Pretests for Children with only First- 
Grade Pretest and Third-Grade Data 

6.7 New York State Reading Subtests and MT October 
Tests for Children with First through Third-Grade 
Data 

6.8 Raw Scores on MAT Posttests (April, 1967) for 
Children with First through Third-Grade Data 

6.9 Intercorrelations of 28 First, Second and Third 
Grade Variables, CRAFT 3 

6.10 Multiple Regression Equations for CRAFT 3, Group I 

6.11 MAT Posttests (April, 1967) Adjusted by CRAFT 1 
Pretests and by CRAFT 2 Posttests for Children with 
First through Third-Grade Data 

6.12 Mean Grade Equivalents for MAT Posttests (April, 
1967) for Children with First through Third-Grade 
Data 

6.13 Kindergarten Experience for Children with First 
through Third-Grade Data 

6.14 Obtained Scores on April MAT Posttests for Children 
with First through Third-Grade Data, Kindergarten 
and No Kindergarten 

6.15 Grade Equivalent Comparison between Children with 
and without Kindergarten Experience, CRAFT 3 

6.16 Third-Grade Raw Scores for Early Readers, CRAFT 3 

6.17 Mean Grade Equivalents for Early Readers on Third- 
Grade Metropolitan Achievement Tests, CRAFT 3 

6.18 Early Readers Compared to Total Population, CRAFT 3 

6.19 Grade Equivalent Comparisons between Early Readers 
and Total Population, CRAFT 3 

6.20 Differences in Grade Equivalent Comparisons of 
Early Readers and Total Population through Grades 
1-3 



LIST OF TABLES (cont.) 



Table 




Page 


6.21 


New York State Reading Sub tests and MAT October 
Tests for Children with only First and Third- 


248 




Grade Data 


6.22 


Raw Scores on MAT Posttests (April, 1967) for 
Children with only First and Third-Grade Data 


249 


6.23 


MAT Posttests (April, 1967) Adjusted by Pretests 
for Children with only First and Third-Grade Data 


250 


6.24 


Kindergarten Experience for Children with only 
First and Third-Grade Data 


251 


6.25 


Obtained Scores on April 14AT Posttests for Child- 
ren with only First and Third-Grade Data, Kinder- 






garten and No Kindergarten 


252 


6.26 


New York State Reading Subtests and IIAT uctober 
Tests for Children with only ; First-Grade Pretest 
and Third-Grade Data 


253 


6.27 


Raw Scores on MT Posttests (April, 1967) for 
Children with only First-Grade Pretest and Third- 






Grade Data 


254 


6.28 


MAT Posttests (April, 1967) Adjusted by Pretests 
for Children with only First-Grade Pretest and 






Third-Grade Data 


255 


6.29 


Kindergarten Experience for Children with only 
First-Grade Pretest and Third-Grade Data 


256 


6.30 


Obtained Scores on April MAT Posttests for Child- 
ren with only First-Grade Pretest and Third-Grade 
Data, Kindergarten and No Kindergarten 


257 


6.31 


Analysis of Variance Results for CRAFT 3 


258 


7.1 


Distribution of Methods in Schools, Replication 1 


260 


7.2 


Educational Level of the Teachers, Replication 1 


261 



Age of Teachers, Replication 1 

xviii 



e 



7.3 



262 



LIST OF TABLES (cont.) 

Table Page 

7.4 Total Years of Teaching Experience for Teachers, 

Replication 1 262 

7.5 First-Grade Experience for Teachers, Replication 1 263 

7.6 Metropolitan Readiness Results for Final Popula- 
tion, Replication 1 264 

7.7 Comparison of Final Replication 1 Population with 

CRAFT 1 Final Population and Norms on Metropolitan 
Readiness Sub tests 265 

7.8 Replication Grade 1 Pretests and Posttests Correla- 
tion Matrix 266 

7.9 Stanford Raw Score Results, Replication 1 

(Child as Unit) 267 

7.10 Stanford Raw Score Results, Replication 1 

(Class as Unit) 268 

7.11 Multiple Regression Equations for Stanford Sub- 
tests Predicted by Pretests, Replication 1 269 

7.12 Adjusted Stanford Results for Replication 1 

(Child as Unit) 270 

7.13 Adjusted Stanford Results for Replication 1 

(Class as Unit) 271 

7.14 Analysis of Variance: Comparison of Approaches on 
Stanford Paragraph Meaning Adjusted by Pretests 

Across All Schools, Replication 1 272 

7.15 Analysis of Variance: Comparison of Methods on 
Stanford Word Study Skills Adjusted by Pretests 

Across All Schools, Replication 1 272 

7.16 Grade Equivalents of Adjusted Means for the Five 

Methods, Replication 1 (Class Is Unit) 273 

7.17 Analysis of Variance: Comparison of CRAFT 1 and 
Replication 1 on Stanford Word Reading 

(Adjusted Scores) 274 

s. 

\ 

7.18 Analysis of Variance: Comparison of CRAFT 1 and 
Replication 1 on Stanford Paragraph Meaning 

(Adjusted Scores) , 275 



xlx 



LIST OF TABLES (cont.) 

Table Page 

7.19 Analysis of Variance: Comparison of CRAFT 1 and 
Replication 1 on Stanford Vocabulary (Adjusted 

Score) 276 

7.20 Analysis of Variance: Comparison of CRAFT 1 and 
Replication 1 on Stanford Spelling (Adjusted Score) 277 

7.21 Analysis of Variance: Comparison of CMFT 1 and 

Replication 1 Word Study Skills (Adjusted Score) 278 

7.22 Mean Grade Equivalents on the Adjusted Stanford 
Posttests for CRAFT 1 and Replication 1 Classes of 

the Four Pilot Teachers 279 

7.23 Results of San Diego Pupil Attitude Inventory In 

Replication 1 (Child as Unit) 280 

7.24 Subsample Oral Reading Raw ScoreResults , Replica- 
tion 1 (Class as Unit) 281 

7.25 Subsample Oral Reading Results Adjusted by Alphabet 

Pretest, Replication 1 (Class as Unit) 282 

7.26 Writing Sample Results for the Subsample of Replica- 
tion 1 (Class as Unit) 283 

7.27 Intercorrelatlons of 40 Variables, Replication 1 

(Class as Unit) 284 

7.28 Reading, Supportive, and Total Time for Replica- 
tion 1 Teachers 292 

7.29 Intercorrelatlon Matrix of Adjusted Stanford Class 

Means and Log Variables, Replication 1 293 

7.30 Results of the San Diego Teacher Inventory at the 

End of Replication 2 296 

7.31 Teacher Competence Rating In Replication 1 297 

8.1 Distribution of Methods In Schools, Replication 2 298 

8.2 Distribution of Pupils In Methods, Replication 2 299 

8.3 Distribution of Pupils In Methods and Schools, 

Replication 2 300 



XX 



LIST OF TABLES (cont.) ‘ 



Tab le Page 

8.4 Teacher Age and Experience In Replication 2 301 

8.5 Raw Score for First-Grade Metropolitan Pretests, 

Replication 2 (Class as Unit) 302 

8.6 Raw Score Results for First-Grade Stanford Post- 
tests, Replication 2 (Class as Unit) 303 

8.7 Raw Score Results for MAT Posttests, Replication 

2 (Class as Unit) 304 

8.8 Intercorrelatlons of 41 First and Second-Grade 

Variables, Replication 2 (Child as Unit) 305 

8.9 Multiple Regression Equations for Metropolitan 

Subtests, Predicted by Pretests, Replication 2 313 

8.10 Multiple Regression Equations for Metropolitan 

Sub tests. Predicted by Post tests. Replication 2 314 

8.11 MAT Posttest Results Adjusted by First-Grade Pre- 
tests, Replication 2 (Class as Unit) 315 

8.12 MAT Posttest Results Adjusted by First-Grade Post- 
tests, Replication 2 (Class as Unit) 316 

8.13 Grade Equivalent Means of CRAFT 2 and Replication 

2 Adjusted by Pretests (Class as Unit) 119 

8.14 Raw Score Results of Measures Related to Interest 

In Reading, Replication (Child as Unit) 317 

8.15 Raw Score Results for Subsample Measures, Replica- 
tion 2 (Class as Unit) 318 

8.16 Regression Equations for Subsample Measures, Pre- 
dicted by Pretests, Replication 2 319 

8.17 Adjusted Subsample Measures, Replication 2 (Class 

as Unit) 320 

8.18 Raw Score Results on Writing Sample, Replication 2 

(Child as Unit) 321 

xxl 



LIST OF TABLES (cont.) 



Table 




Page 


8.19 


Analysis of Variance Results for Replication 2 


322 


8.20 


Analysis of Variance: Comparison of CRAFT 2 and 
Replication 2 Word Discrimination Adjusted by 
Pretests 


323 


8.21 


Summary of ^ Values Obtained In Analyses of Vari- 
ance Comparing CRAFT 2 and Replication 2 Results 


324 


8.22 


Comparison of Boys and Girls on Metropolitan Pre- 
tests, Replication 1 


325 


8.23 


Comparison of Boys and Girls on Metropolitan Pre- 
tests, Replication 2 


326 


8.24 


Raw Score Stanford Results for Boys and Girls, 
Replication 1 


327 


8.25 


Grade Equivalents of Raw Score Stanford Posttest 
Means for Boys and Girls, Replication 1 


328 


8.26 


Raw Score MAT Results for Boys and Girls, Repli- 
cation 2 


329 


8.27 


Grade Equivalents of MAT Raw Score Means for Boys 
and Girls, Replication 2 


330 


8.28 


Raw Score Metropolitan Pretest Results for Child- 
ren with and without Full Kindergarten Experience, 
Replication 2 


331 


8.29 


Raw Score Stanford Posttest Results for Children 
with and without Full Kindergarten Experience, 
Replication 2 


332 


8.30 


Grade Equivalents of Raw Score Stanford Posttest 
Means for Children with and without Full Kinder- 
garten Experience, Replication 2 


333 


8.31 


Raw Score MAT Posttest Results for Children with 
and without Full Kindergarten Experience, Repli- 
cation 2 


334 



xxii 



LIST OF TABLES (cont.) 



Table Page 

8.32 Grade Equivalents of Raw Score MAT Posttest Means 

for Children with and without Full Kindergarten 
Experience, Replication 2 335 

8.33 Correlations of 60 Variables with MAT Adjusted 

Class Means, Replication 2 336 

8.34 Teacher Competence Rating for Replication 2 338 

8.35 Comparisons of the Three Scales of the San Diego 
Teacher Inventory of Approaches to the Teaching 

of Reading, Replication 2 339 

8.36 Teachers' Attitude toward CRAFT Method, Replica- 
tion 2 340 

8.37 Reading, Supportive and Total Time for Replica- 
tion 2 Teachers 341 

8.38 Mean Time in Minutes Per Day on Reading and Sup- 
portive Activities, Replication 2 342 



xxiii 



o 

ERIC 

hiaiffliifftaniiaaa 



LIST OF FIGURES 



Figure Page 

1 The CRAFT Study Over Three Years 2 

2 Grade Equivalents by class, method and treatment 

for the MAT reading sub test second-grade continu- 
ation 59A 

3 Distribution of CRAFT First-Grade Children in 

Third Grade 85 



xxlv 



CHAPTER I 



INTRODUCTION 



The CRAFT* Project is a three-year comparative study of methods 
of teaching reading to disadvantaged Negro children in New York City. 
The first year, 1964-65, CRAFT was one of the 27 studies of first 
grade reading that received financial assistance from the U.S. Office 
of Education and were aided by a special coordinating center at the 
University of Minnesota. CRAFT received a second contract from the 
U.S.O.E. for a 2-1/2 year extension in order to continue with the 
specific teaching methods in the second grade and then to follow-up 
the children through the third grade. The present report is the 
final report of the full three-year project, and contains detailed 
analyses of the second and third grade results. For brevity and con- 
venience, the first grade study will be referred to below as CRAFT 1, 
the second grade continuation as CRAFT 2, and the third grade follow- 
up as CRAFT 3. 

A number of reports about this project have already been made 
public. A detailed report on the first year of the project was pub- 
lished on March 1, 1966 (Harris & Serwer, 1966a); copies were quick- 
ly exhausted, but the report may be obtained in microfiche or hard 
copy through ERIC (Educational Resources Information Center of the 
U.S. Office of Education) as ED 010 037. A brief summary of CRAFT 1 
was published in the May, 1966 issue of The Reading Teacher (Harris & 
Serwer, 1966b) and has been reprinted in a volume containing the sum- 
maries of the 27 cooperative first grade reading projects (Stauffer, 
1967) . A supplementary analysis of instructional time as a factor in 
the CRAFT 1 results was published in the Reading Research Quarterly 
(Harris & Serwer, 1966c). A brief summary of the CRAFT 2 findings ap- 
peared in the. May, 1967 issue of The Reading Teacher (Harris, Sender, . 
& Gold, 1967). 

The present volume also contains a report of the CRAFT Replica- 
tion Project which was carried out in first grade classes in 1965-66 
and in second grade classes in 1966—67, with local resources. The 
first grade replication will be called Replication 1 below, and the 
second grade replication will be called Replication 2. 

In later chapters, familiarity with CRAFT 1 procedure and results 
will be assumed. For this reason, it seems desirable to present a 
summary of CRAFT 1 here. 



*Comparison of Reading ^proaches in First Grade Reaching with 
Disadvantaged Children. 
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Figure 1: The CRAFT Study Over Three Years 



1. First Year of the CRAFT Project 



CRAFT 1 was planned in the spring and summer of 1964 and oper- 
ated during the 1964-65 school year. 

The Schools 

The project operated in 12 New York City elementary schools. 

Two schools were located in central Harlem; six in the Bedford-Stuy- 
vesant section of Brooklyn; and four in the South Jamaica section of 
Queens. Pupil populations in all of the schools were almost 100 per 
cent Negro. All schools were known to have been at least a half- 
year retarded on the most recent city-wide reading test in third 
grade; median grade scores for the schools near the end of third 
grade had ranged from 2.6 to 3.4. Eleven of the 12 schools were in 
neighborhoods with median annual family incomes ranging from $3,744 
to $3,918. The twelfth school, in a lower middle-class Negro neigh- 
borhood, was known to enroll a large number of dependent children 
placed in foster homes. 

There were 48 experimental classes, four in each school. All 
of the schools had other first-grade classes that were not involved 
in the experiment. 

Instructional Methods 

The main comparison was between a Skllls-Centered Approach and 
a Language-Experience Approach. The SC Approach emphasized the need 
for order, structure, and built-in repetition. Skills were intro- 
duced in specific sequences, the vocabulary was carefully controlled, 
and the teacher followed manuals that gave detailed lesson plans. 

Two skills-centered methods were used. 

The first of these was the BR Method, in which the teachers used 
the full materials supplied by the publisher (preprimers, primer, 
first reader, accompanying workbooks, word and phrase cards) and fol- 
lowed the lesson plans in the teachers' manuals as closely as possible. 
The three basal series available in the experimental schools (Scott, 
Foresman Basic Readers; Ginn Basic Readers; Harper & Row Alice and 
Jerry books) were judged to be sufficiently similar in content and 
methodology to be considered together as providing one method.’^ Teach- 
ers were encouraged to use an "enriched" rather than an "impoverished" 
interpretation of the BR Method. Thus, they were encouraged to utilize 
the suggestions in the manuals for enrichment and supplementary activi- 
ties, to encourage oral and written expression, and to teach social 



^Although original plans called for use of "integrated" basal 
readers, none of the publishers had such materials complete for the 
first grade by September, 1964. 



3 









studies, science, art, and music, as prescribed In the city curri- 
culum. 

The other skllls-centered method, called the Phonovlsual Method 
(PV), combined use of basal readers for silent and oral reading with 
an Intensive, systematic phonics method for teaching word recognition 
(the Phonovlsual Method) . Each day the teacher taught a phonics les- 
son for 20 to 30 minutes, substituting this for the program In phonics 
and structural analysis contained In the basal reader manuals. At a 
separate time the teacher taught new vocabulary and conducted oral 
and silent reading In a basal reader. Provisions for enrichment were 
Intended to be the same In both skllls-centered methods. 

The Language-Experience Approach emphasized the need for self- 
expression through the use of the child's oral language as a basis 
for beginning reading materials. Shared experiences were provided by 
the teacher through taking trips and classroom experiences with pets, 
science experiments, etc. Other experiences came from the personal 
lives of the children. Out of the discussion of these varied experi- 
ences, charts were developed and used for reading and writing, for 
skills Instruction, and for drill. There was a gradual transition to 
reading books In small groups and eventually to Individualized reading. 

The Language-Experience Approach Included two methods. These 
differed In the amount of audio-visual equipment and training provided 
to the teachers. The "regular" Language-Experience Method (LE) al- 
lowed the teachers to use whatever audio-visual equipment and sup- 
plies were normally available to them (actually very little) , but did 
not provide any extra AV resources or any training In the use of AV 
procedures In the teaching of reading. 

The Language-Experience Audio-Visual Method (LE-AV) provided Its 
teachers with a variety of AV equipment: overhead projectors, Polar- 

oid and Kodak cameras, fllni-strlp projectors, tape recorders, sets of 
earphones for a listening corner, etc. A half-time audio-visual con- 
sultant gave specific Instruction In the use of the equipment and co- 
operated with the reading consultants In the development of AV teach- 
ing methodology. 

There were, then, two approaches (Skllls-Centered and Language- 
Experience) , and four methods : 1 , Basal Reader (BR) ; II , Phonqvlsual 

(PV); III, Language-Experience (LE); and IV, Language-Experience, Audio- 
Visual (LE-AV). There were 12 classes for each method, 24 classes for 
each approach. Within each school there were two Skills -Centered 
classes and two Language-Experience classes. Thus each SC Method oper- 
ated In six schools, and each LE Method In six schools. The methods 
were paired as follows: 1 with III In three schools; 11 with 111 In 

three schools; I with IV In three schools; and II with IV In three 
schools. These four patterns were assigned to the schools by drawing 
lots. 
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Subjects 

From the total first-grade enrollment In each school enough 
names were chosen at random for four classes. These children were 
assigned at random to the two methods,’^ with care taken to balance 
those with or without kindergarten experience. About two-thirds of 
the children had attended kindergarten while about one-third had not. 

At the opening of school there were about 1,700 children In the 
48 classes, with a mean of 35 children per class. There were approxi- 
mately equal numbers of boys and girls . The number who completed the 
pretest program In October was 1,372. By the time the posttests were 
completed, early In June, there was a further loss of 17.2 per cent, 
leaving 1,141 pupils for whom both pretest and final scores were 
available. These comprised the first-grade experimental population. 

As pupils transferred from experimental classes to other schools they 
were replaced by new entrants, keeping class size fairly constant and 
equal to the average size of non-experlmental first-grade classes In 
the same schools. The children were considerably retarded In most as- 
pects of reading readiness, as explained below. 

Teachers 

The teachers had volunteered for the project, knowing that they 
would be paid for the required after-school work such as attending 
workshop sessions and filling out research forms, and that the princi- 
pals favored their participation. Within each school the teachers 
drew lots for the two methods assigned to that school. 

The teachers varied greatly In age and experience. Most were 
very young; a few were near retirement. Total experience ranged from 
0 to 40 years; first-grade teaching experience ranged from 0 to 29 
years, with a mode of one year and a median of two years. Most of 
the teachers had bachelor degrees with some graduate work short of a 
master's degree. On the administration of the San Diego Teacher In- 
ventory of Approaches to Teaching of Reading at the beginning of the 
year there was a general preference for the "Basic" scale, with no 
significant differences among the groups assigned to the four methods. 

An Intensive teacher- training program was carried out by the 
project's assistant director and the six part-time consultants pro- 
vided by the Board of Education (four in reading, one in early child- 
hood education, one in audio-visual Instruction). A workshop for 
each of the four methods met twice before school opened, then weekly 
for three months, then bi-weekly. Each teacher was visited by the 

*In two schools a class of high-rated kindergarten children was 
set apart, and randomized choice of children for CRAFT classes was 
made among the remaining children. In another school, a few extreme- 
ly slow children were removed before randomized assignment. 
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assistant director and a reading consultant; these visits were fol- 
lowed by evaluative discussions. The audio-visual consultant worked 
only with the 12 LE-AV teachers. The early childhood consultant was 
especially helpful in structuring the five-week readiness period 
which ended with the completion of the pretests. 

Tests 



Pretests included: Murphy-Durrell Diagnostic Reading Readiness 

Tests, Metropolitan Readiness Test (Word Meaning and Listening sub- 
tests), and Thurstone Pattern Copying and Identical forms. Four sub- 
tests were usable as covar latest Murphy-Durrell Learning Rate, 
Metropolitan Word Meaning and Listening, and Thurstone Pattern Copy- 
ing. 



For posttests, the Stanford Primary I Battery, Form X, was given 
to all pupils. Several oral reading tests and two samples of written 
composition were scored for a randomly selected sample of four child- 
ren (t^^o boys, two girls) from each class. 

The San Diego Inventory of Pupil Attitude was also administered 
as a group test, and the San Diego Teacher Inventory was filled out 
again by each teacher near the end of the year. 

Experimental and Statistical Procedures 

The instructional period was 140 days from the final pretest to 
the first posttest. Teachers in the nine schools with full five-hour 
days (9-12, 1-3) were instructed to spend 180 minutes a day on read- 
ing and supportive activities; those in the three schools which were 
limited to a four-hour day (8-12) because of over-crowding were in- 
structed to spend 150 minutes a day. 

All four methods were treated as "experimental" methods and there 
was no "control group" in the usual sense. Hawthorne effect should 
have been fairly equal among the methods. Three groups of teachers 
were using instructional procedures new to them, and the fourth grjup 
(BR) was using a procedure somewhat different from their previous prac 
tlces. 

Uniqueness of the four methods was established by class visits, 
by scores derived from Daily Logs kept by the teachers for five con- 
secutive days each month, and from scores derived from OScAR R, an 
observational procedure developed for the project by Donald M. Medley. 

The statistical program was carried out ik'ith IBM 7040 and 7094 
computers. The following steps were taken: 

1. Intercorrelations were computed between the pretests 
and the five Stanford subtests. Because of data miss- 
ing for some classes (due to faults in test administra- 
tion) the number of usable pretests was reduced to four, 
as listed above. 
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A program for multiple covariance with unequal N's was 
adapted from Cooley and Lohnes (1962), and adjusted class 
means were obtained for each Stanford sub test. 

3. The adjusted means were used in a three-way analysis of 
variance which checked for differences between approaches; 
between the two methods in each approach; and for school 
differences. 

4. The results of the Individually administered tests were 
similarly treated. The covariance program was applied 
to the Gilmore Accuracy Score, the Gates Word Pronuncia- 
tion Test, and the "lucidity" score derived from one of 
the written compositions. 

5. An Intercorrelation matrix of 54 input and adjusted out- 
come measures was scanned for correlations that might re- 
veal significant factors. Those located were then studied 
further. 

Pretest Results 

The mean score for the CRAFT 1 pupils in October on the seven 
pretests for which percentile norms were available ranged from the 
first percentile to the 44th percentile, with a median at the 20th 
percentile. They had great difficulty with the Murphy-Durrell Pho- 
nemes sub test, with many zero scores and a mean at the first percen- 
tile. A serious vocabulary deficiency was shown on the Metropolitan 
Word Meaning sub test (14th percentile). The relatively good showing 
(44th percentile) on the Murphy-Durrell Learning Rate sub test, a kind 
of standardized lesson in which words are taught by a "look and say" 
procedure and then tested, suggested comparatively good ability to 
learn by a sight recognition method. 

Post test Results 



The most conspicuous finding of the in tercor relational analysis 
was that the teacher's use of time was significant. The Dally Logs 
kept by the 48 teachers for five consecutive days in five consecutive 
months provided scores for Total Time, Reading Time, and Supportive 
Activities Time. Reading Time had significant correlations with the 
adjusted class means on most of the posttests, ranging from .40 to .61. 
Correlations for Total Time and Supportive Activities Time were not 
significant. 

The two Approaches were compared to see how teachers used their 
time. Total instructional time per day was quite similar: a mean of 

170 minutes for Skills-Centered teachers, 175 minutes for Language- 
Experience teachers. However, the Skills-Centered teachers spent 55 
per cent of their time on Reading activities, while the Language-Ex- 
perience teachers spent only 39 per cent on Reading and the other 61 
per cent on Supportive Activities. 
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A comparison was made of the results in the three split“ses“ 
Sion" schools with the nine full-day schools. Of fifteen compari- 
sons, 11 showed significant differences favoring the full-session 
schools. The LE-AV Method was more severely handicapped in the 
split— session schools than either of the Skills— Centered methods . 
There were no regular LE classes in the split-session schools. 

Because of these findings, the final comparisons between ap- 
proaches and methods were based on the adjusted class means for the 
full-session schools only. Analyses of variance were computed for 
each test between the two approaches, and between the two methods 
within each approach. 

The results of these analyses may be summarized as follows: 

1. Between BR and PV, the only significant difference was 
in favor of BR on Paragraph Meaning. 

2. Between LE and LE-AV, the latter was ahead on all seven 
measures, with statistically significant differences on 
four of the measures, and equalled SC results. 

3. The LE Method had the poorest results of the four methods. 

4. The Skills-Centered Approach surpassed the Language-Exper- 
ience Approach on six measures, with significant differ- 
ences on four of them (Stanford Word Reading, Spelling, 
and Word Study Skills, and Gilmore Accuracy). 

5. When the raw score means were translated into grade equi- 
valents many of the differences disappeared (a difference 
of more than three raw score points may be needed to show 
a grade score difference of one-tenth of a year) . The 
grade score means are shown in Table 1.1. Most of the 
differences between methods were of the order of one-tenth 
of a year. Even when such differences are statistically 
significant, they are not of much practical consequence. 

6. The CRAFT pupils made higher mean grade scores on the Gil- 
more Accuracy (1.8) and Gates (2.3) individually adminis- 
tered tests than on the sub tests of the Stanford, on which 
their mean was 1.5. 

7. Analyses were also carried out on a number of unadjusted 
post test measures on which the covariance analysis coiild 
not be performed. 

a. On the San Diego Inventory of Pupil Attitude the BR 
Method was significantly highest, and the PV Method 
was lowest. 
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Table 1.1 



Adjusted Grade Score Means for Full-Session Classes, GRAFT 1 



Test 


Skills -Centered 
Approach 


Language-Experience 

Approach 


BR 


py 


Total 


LE 


LE-AV 


Total 


Stanford 














Word Reading 


1.5 


1.6 


1.5 


1.4 


. 1-5 


1.5 


Paragraph Meaning 


1.6 


1.5 


1.5 


1.5 


1.5 


1.5 


Vocabulary 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


Spelling 


1.7 


1.7 


1.7 


1.6 


1.7 


1.6 


Word Study Skills 


1.5 


1.5 


1-5 


1.4 


1.5 


1.4 


Gilmore Oral, Accuracy 


2.0 


1.8 


1.9 


1.7 


2.0 


1.8 


Gates Word Pronunciation 


2.4 


2.3 


2.3 


2.3 


2.3 


2.3 



b. The SC Approach scored substantially higher than the LE 

Approach on three tests individually administered to 
the sample of four children per class: the Gilmore Rate 

score, the Fry List of Phonetically Regular Words, and 
the Karlsen Phonemic Word List. However, a similar dif- 
ference on the Gates Word Pronunciation proved not to be 
significant after covariance adjustments, and therefore 
the significance of the differences on the unadjusted 
word lists is doubtful. The PV Method had somewhat higher 
means than the BR Method on these tests. 

c. None of the several scores based on the two writing 
samples showed significant differences between approaches 
or methods. 

8. Following the publication of the CRAFT 1 report, a further 
analysis of instructional time was carried out (Harris & Ser- 
wer, 1966c). The Stanford Word Meaning and Paragraph Meaning 
adjusted class means were used for this analysis, \7hen cor- 
relations were computed separately for each method (with a 
maximum of 10 degrees of freedom) , they had to be quite sub- 
stantial to be significantly greater than zero. 

a. The correlations between Reading Time and posttests were 
highest and significant for 3R, lot<7est and non-signifi- 
cant for LE, and doubtfully significant for PV and LE-AV. 
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b. Each of the four methods had a distinctive pattern of 
time distribution; but there was substantial variation 
among the teachers in any one method. 

c. Of five kinds of reading activities and 10 supportive 
activities* none was related to achievement consist- 
ently in all four methods. There was, however, a gen- 
eral tendency for the teachers who spent more time on 
the activities distinctively characteristic of their 
prescribed method to get better results than those who 
spent less time on these activities. Time spent with 
basal readers and in sight word teaching was most signi- 
ficant in the BR Method. Time spent in writing, drama- 
tization, social studies, and science was significant 
for the LE Method. Audio-Visual time was positively re- 
lated to outcomes for the LE-AV teachers and gave pre- 
dominantly negative correlations for the other three 
methods. For the PV Method the only significant corre- 
lations were positive with story telling and with art. 

9. The Medley OScAR R observational schedule was developed for 
this project in an attempt to accomplish two separate tasks. 

The first was to verify that there were genuine differences 
among the methods; this was accomplished. The second was to 
check whether certain observable characteristics of teacher 
behavior. Independent of method, would affect pupil learning. 

In the CRAFT 1 report it was stated that none of the OScAR R 
scores correlated significantly with achievement. A further 
analysis of the first-grade data done subsequently has shown 
some significant correlations that are specific to a parti- 
cular Instructional method. Details will be given in Chap- 
ter V. 

2. The Rationale for Continuation 

In planning the CRAFT Project, it was hoped from the beginning 
that it would be possible to follow the progress of the pupils through 
at least the second grade, and preferably through the third grade. 

There were several lines of reasoning, all of which pointed in the dlrec 
tlon of continuing the study beyond first grade. 

Several studies comparing methods of teaching reading had shown 
that the method which is ahead at the end of the first grade is not ne- 
cessarily ahead at the end of the third grade. One of the best known 
of these (Sparks & Fay, 1957) compared a specific method of intensive 
phonics Instruction with basal reader instruction; although the phonics 
method was clearly ahead at the end of the first grade, the two methods 
were not significantly different in their results at the end of the 
third grade. Another relevant study compared the effects of different 
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amounts of readiness work before beginning reading instruction, for 
children low in readiness (Bradley, 1956). The control group was 
given reading instruction from the beginning of the first grade; ex- 
perimental pupils were given readiness work for 5, 8, or 10 months. 
Early in the second grade, the control group was well ahead. But 
by the end of second grade the two groups were equal, and by the end 
of third grade the differences, although not statistically signifi- 
cant, favored the readiness group. 

There was some reason to anticipate that the Language-Experi- 
ence Approach might have delayed beneficial effects. The emphasis 
in this method on providing new information and ideas, and giving 
much attention to oral language development, made it probable that 
\less time would be devoted by LE teachers to the teaching of word 
recognition skills in first grade. As has been noted above, they ac- 
tually did spend less time on reading activities as compared with 
supportive activities. The language emphasis might, it was thought, 
show an advantage at a later point in reading when word recognition 
becomes subordinate to comprehension. It was also noted that stand- 
ardized first-grade achievement tests would be more likely to con- 
tain basal reader vocabulary than experience chart vocabulary. This 
trend would be less marked in second and third-grade reading tests 
as test vocabulary becomes more general and book reading becomes a 
more Important part of LE procedure. 

Another method which was thought to have possibilities of de- 
layed benefit was the Phonovlsual Method. On the pretest most 
closely related to aptitude for phonic learning (Murphy-Durrell Pho- 
nemes), the CRAFT 1 children as a total group had scored very low. 

It therefore seemed possible that they would take longer to master 
the phonic system, and that functional use of phonic skills might 
not become evident for many of them until the second grade. 

The plan for the study called for maintaining the special fea- 
tures of each method through CRAFT 2. While this entailed consider- 
able effort in teacher training, it seemed far better to try to keep 
the. methods distinct as long as possible, rather than just to follow 
up the progress of the children in an uncontrolled second-grade read- 
ing program. By maintaining the methods, their possible delayed ef- 
fects would have a real chance to become evident . 

Knowing the high pupil turnover rate in the schools being used, 
it did not seem possible to maintain experimental classes through the 
third grade. Considerably more than half of the children could be 
expected to leave their original schools before the end of the third 
year. However, city^ide third-grade reading tests made it possible 
to plan to follow the individual children through the third grade. 
Record-keeping procedures were established which made it possible to 
locate the schools to which pupils moved, and to retrieve their scores 
on the third-grade city-wide tests. 
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3. Plan of the Continuation Study 



The Second-Grade Plan 

Briefly, the plan for CRAFT 2 was to maintain the two approach- 
es and four methods of CRAFT 1 as intact as possible through the 
second grade, and to compare results after a uniform period of second- 
grade instruction* Adjustments had to be made to the gradual loss 
of pupils and to the loss of one of the original 12 schools. A pro- 
gram was set up to train the second-grade teachers in the specifics of 
the methods to which they were assigned* The assistant project direc- 
tor and several consultants taught the workshops and visited and con- 
sulted with the teachers. The CRAFT 2 testing program included group 
testing (Metropolitan) in reading, spelling, arithmetic, and attitude 
toward reading (San Diego) , and measures of oral reading, word recogni- 
tion, and written composition were secured for a sample of four child- 
ren per class* Teacher use of time was recorded in Daily Logs, and 
teacher behavior was recorded through use of the OScAR R* 

The procedures of CRAFT 2, very briefly outlined in the preceding 
paragraph, are described in Chapter III. 

The Third-Grade Plan (CRAFT 3) 

The procedures that made it possible to follow the children 
through the third grade may be briefly summarized as follows: (1) At 

the beginning of the first grade the permanent record card of each 
CRAFT pupil was conspicuously stamped with the word CRAFT. (2) At 
any time during the three years, when a CRAFT pupil left the school, 
the clerk kept a record of the new school to which the child’s records 
were sent. (3) These records were collected periodically by the re- 
search staff and the changes were recorded. (4) The child’s new school 
was sent a communication indicating the project’s Interest in follow-- 
ing all CRAFT children and requesting notification if any CRAFT child 
transferred again* (5) During the Fall of 1966, a research assistant 
spent many weeks setting up new record books by school and class for 
all of the original 1,372 CRAFT 1 children who could be located. (6) 
Three sets of reading tests were administered city-wide during the 
1966-67 year: the New York State Reading Test in October; Metropoli- 

tan reading tests in November; and Metropolitan reading and arithmetic 
tests in April. When the results of these tests became available re- 
search assistants spent many days at the Board of Education offices 
copying the scores of the CRAFT children. (7) Appropriate statisti- 
cal procedures were used in analyzing the third-grade results. 

The procedures of the third-grade part of the continuation study 
are given in greater detail in Chapter VI. 



4. The Rationale for Replication 



In both CRi\FT 1 and CRAFT 2 there was no time to pretrain the 
teachers. Although there were workshop meetings before the beginning 
of the school year, the bulk of the training had to be given during 
the year. The teachers learned the special features of the method to 
which they were assigned as they used It. It can be expected that 
the results will show what teachers can do when a method Is new to 
them. The more unfamiliar a method may be, the more It may be handi- 
capped In such a comparison. 

In the original proposal for the CRAFT Project there was provi- 
sion for repeating or replicating the study by having the same teach- 
ers use the same methods with a new group of children. In both first 
and second grades. This would. It was expected, provide a comparison 
of the methods when used by teachers who had become reasonably famil- 
iar with. the method. 

Funds for replication were not Included In the U.S.O.E. contract 
under which CRAFT 2 and CRAFT 3 were carried out. However, local re- 
sources were found to support the "replication study" and Its results 
will be presented In Chapters VII and VIII. 



5. Plan of the Replication Study 



Replication In First Grade 

The main purpose of the Replication Study was to find out wheth- 
er a year of prior experience In using one of the CRAFT methods had 
any significant effects on the results teachers were able to get with 
the method. 

All of the 48 first-grade CRAFT teachers were Invited to remain 
In the project for a second year, repeating the same teaching method 
with a new group of pupils. Thirty agreed to do so. Of the 18 who 
did not, 13 were unavailable for such reasons as promotion to a non- 
teaching position, moving out of the city, or maternity leave. 

Of the 30 teachers, 26 were assigned during 1965-66 to replicate 
the method they had used the previous year. Four teachers took part 
in a "Pilot Study" trying a new method which was a combination of LE- 
AV with Phonovisual. Thus there were five methods in Replication 1: 
the original four methods, and the new "Pilot" method. The four 
"Pilot" teachers had all used either LE-AV or PV in the first year. 

The Replication 1 research design was as close as possible to 
the original CRAFT design. A brief readiness period was conducted. 
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followed by the administration of pretests early in October. Work- 
shop and supervisory activities were less intensive than in the 
first year. The Stanford Primary I Battery was administered after 
140 days of instruction, and measures of oral reading and written 
composition were obtained for a random sample of four children per 
class. The San Diego pupil and teacher inventories were also admin- 
istered as posttests. The statistical treatment was very similar 
to that used in CRAFT 2. Replication 1 procedures and results are 
described In Chapter VII. 

Replication In the Second Grade 

The plan for Replication 2 was to maintain as many as possible 
of the 30 first-grade classes through another year of instruction 
with the same method as in the first grade, taught by a second-grade 
teacher who had used that method in CRAFT 2. Thus, in 1966—67 there 
were 26 Replication 2 classes, 5 or 6 classes for each of the four 
original methods and 4 classes in the Pilot Method. The procedures 
and measurement program were very similar to those used in CRAFT 2. 
Second-grade Replication 2 procedures and results are described in 
Chapter VIII. 



6. Objectives 



The main objectives of CRAFT 2 may be. stated as follows: 

1. To determine the growth of the CRAFT children in several 
aspects of reading and writing during a period of nearly 
two years of reading Instruction. 

2. To compare the reading achievement of CRAFT children with 
that of children who entered the experimental classes after 
the instructional program began and therefore were not part 
of the experimental population. 

3. To determine if there were significant differences in read- 
ing achievement between Approaches and Methods over the 
two-year period. 

4. To determine if there were significant differences in reading 
achievement between Approaches and Methods in the second 
grade . 

5. To compare the progress in reading over two years of specific 
sub-groups: 

a. Boys and girls 

b. Early readers and the rest of the CRAFT population 

c. Children with and without kindergarten experience 
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6. 



To determine If there are patterns of high and low achieve- 
ment scores characteristic of the CRAFT population as a 
whole, or of a particular approach or method. 

7. To analyze the use of instructional time in the four methods 
and to inquire into the relationship between the use of time 
and pupil achievement. 

8. To analyze the various data concerning teachers, including 
age, education, experience, attitudes toward teaching 
methods (San Diego), and aspects of teaching procedure 
(OScAR R) for clues concerning the reasons, for differences 
in results among the teachers using the same teaching 
method. 

The main objectives of CRAFT 3 may be stated as follows: 

1. To determine how children taught for two years in CRAFT 
classes achieved in reading during the third grade. 

2. To compare the reading results for the two approaches and 
four methods after three years of reading instruction. 

3. To determine if there are significant differences In amount 
of reading gain during the third grade, when comparisons 
are made by approach, by method, and by sex. 

4. To compare the reading achievement of children who had two 
years of CRAFT instruction with that of (a) children who 
had between one and two years of CRAFT instruction; and 

(b) children who had less than one year of CRAFT Instruction. 

5. To compare the reading achievement in third grade of children 
with and without kindergarten experience. 

6. To trace through the third grade the progress in reading of 
children who were identified as early readers at the begin- 
ning of first grade, as a total group and by approach. 

The main objectives of Replication 1 may be stated as follows: 

1. To compare the results of the two approaches and four 
methods when taught by teachers who had a year of prior 
experience in teaching with the same method. 

2. To study the learning results of the Pilot Method, combining 
PV and LE-AV features. 

3. To compare the results of the teachers in each method in 
Replication 1 with the results of the same teachers in CRAFT 1. 

4. To. study the use of instructional time in Replication 1 and 
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the relationship of time variables to pupil achievement. 

5. To check on the hypothesis that teachers In the LE 
Approach would, because of the greater unfamlllarlty of 
that Approach, show more gain In pupil reading achievement 
than teachers In the SC Approach. 

6. To check on the hypothesis that teachers in the PV and 
BR methods would achieve approximately equal results. 

7. To check on the hypothesis that teachers in the LE-AV 
method would achieve better results than teachers In 
the LE Method. 

8. To check on the hypothesis that teachers In the Pilot 
Method would show greater pupil achievement In reading 
than during the preceding year when they had used the 
PV or LE-AV Method. 

The main objectives of Replication 2 may be stated as follows: 

1. To compare the results of the two approaches and four 
methods when the children had been taught for two years 
by teachers who had a year of prior experience with the 
same method. 

2. To study the results of the Pilot Method over a two-year 
period. 

3. To compare the results of the second grade teachers In 
Replication 2 with the results of the same teachers In 
CRAFT 2. 

4. To study the relationships of Instructional time to 
achievement In Replication 2. 

5. To check the hypothesis that the LE Approach would compare 
more favorably with the SC Approach In Replication 2 than In 
CRAFT 2. 

6. To check the hypothesis that there would be no significant 
differences between the BR and PV Methods after two years 
of Instruction by teachers experienced in the method. 

7. To check the hypothesis that there would be no significant 
differences between the LE and LE-AV Methods after two 
years of Instruction by teachers experienced in the method. 

8. To check on the hypothesis that the Pilot Method would not 
differ significantly in results from the original four 
methods after two years. 
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9. To study the Influence of kindergarten experience on 
reading achievement In Replication 2. 

10. To study the Influence of sex on reading achievement 
In Replication 2. 
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CHAPTER II 



RELATED RESEARCH 



While the literature on the teaching of beginning reading Is 
voluminous and research studies In that area have been plentiful, 
research concerned specifically with the reading Instruction of 
young, disadvantaged, urban Negro children Is very scarce. 

The recency of professional concern with the reading problems 
of the disadvantaged In general can be shown by Inspecting the pro- 
grams of the annual conventions of t'r International Reading Asso- 
ciation. From 1956 through 1963, there were no papers In the con- 
vention programs whose titles Indicated that they were specifically 
concerned with the reading problems of the disadvantaged. In the 
1964 program, however, there were 13 papers In this area. In a 
U.S.O.E. bulletin entitled Teaching Young Children to Read , dated 
1964 but giving the proceedings of a conference held In November, 
1962, none of the titles of papers Indicates a concern with the dis- 
advantaged (Cutts, 1964). General concern with the reading problems 
of the disadvantaged seems to have arisen shortly after 1960, and 
to have resulted In printed papers and reports starting In 1963 or 
1964. 



Considering the recency of this concern, a paucity of published 
research In this area Is Inevitable. Nevertheless It Is striking 
that In two books about teaching the disadvantaged which were pub- 
lished during 1966, one (Crow, 1966) does not discuss beginning read- 
ing methodology at all, while the other (Loretan & Umans, 1966) cov- 
ers "Reading and Listening Skills In the Early Grades" In a chapter 
of only eight pages. 

In 1S65 a task force of the National Council of Teachers of 
English attempted to determine the effectiveness of language learn- 
ing In special projects and programs for the disadvantaged across the 
U.S.A. Between March and July, 1965, 22 observers visited and re- 
ported on 190 programs, administered by 115 separate districts and 
agencies located In 64 different cities. The CRAFT Project was one 
of those visited. The task force report (Corbin and Crosby, 1965) 
was published In November, 1965. The report covered six areas — pre- 
school, elementary, secondary, English as a second language, adult, 
and teacher training, and reading was but one of the aspects of lan- 
guage with which It was concerned. Nevertheless the four pages de- 
voted to elementary reading contain some Interesting observations. 
"Most schools visited used some form of a basal reader; others were 
using such approaches as Words In Color, l.t.&>, Phonovlsual, Lan- 
guage Experience, and Individualized reading programs. . . Even a 
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brief visit to research programs In reading revealed that more atten- 
tion, materials, consultant help, and overall expectations ,wex:e given 
to experimental groups as opposed to control groups. It would be In*- 
teres ting to reverse the procedure, i . Some observers believe- that 
Impressive results from l.t.a. and other new approaches to reading .. 
result less from the new approach than from emphasis placed bn. reading 
through the school day" (p. 84). Most of the primary grade reading; 
programs listed In the report were of an Informal tryout or action re- 
search nature, rather than carefully contrcilled experimentation; end 
they were programs in progress from which, final reports could not be 
expected for some time* 

1. Readiness for the Disadvantaged 

The heed for concentrated attention to the readiness deficits of 
disadvantaged children, and particularly of disadvantaged Negro chil- 
dren, has been stressed by Martin Deutsch.. In one of his studies a 
wide variety of tests were given to Negro and white children of vary- 
ing socio-economic status, at first-grade and fifth-grade levels, 
"significant correlations with race were. found In eight conparlsons 
for the first graders , and In 18 for the fifth grade > sample. The. num- 
ber of significant comparisons on SES for each group, was 22*" (Deutsch, 
1965) In other words , Inadequate patterns . of language behavior char- 
acter! sed disadvantaged children In general, but In addltioh disadvan- 
taged 'legro children fell increasingly behind the disadvantaged yhlte 
children between first grade and fifth grade. Deutsch's. results bhve 
been Influential In marshalling support for. preschool compensatory edu- 
catibn . . . 

The Head Start Program, begun in the summer of 1965 in.a.largs . 
number of communities with stippiort from /f^he Offlce. of Economic .Oppor- 
tunity, Is a large scale effort to improve the school readiness of pre- 
school disadvantaged children. As yet there has not been sufficient; 
time to determine the effects oif Head Start ; attendance on progress -In 
reading (Slibersteln, 1966)* CRAFT 1 started nearly a year before the 
first Head Start programs in New York City, so none of the children in 
CRAFT 1 were enrolled in any Head Start program. In Replication 1 and 2 
the number of children who had had Head Start experience was too small 
to warrant any conclusions. 

An evaluation of pre-kindergarten programs for educationally dis- 
advantaged children over a two-year period has been reported by staff 
of the New York State Education Department (D1 Lorenzo & Salter, 1967). 
Eight districts were involved. In general, beneficial effects were 
found on Intelligence and language measures » and the more effective pre- 
kindergarten programs ware, those with specific, structured cognitive 
activities. .White experimental children maintained an, advantAge through 
kindergarten but did hot Increase It; nonwhite experimental ctilidren did 
not maintain their advantage over their control s. . It was c<mciilde(l that 
modifications in klnderjgarten. and the early grades: will probably be ; 
necessary if pre4clndergarten is to have lasting value. 

19 



An earlier study investigated the long-range ieffects of a first- 
grade readiness program (Bradley, 1956) with disadvantaged children In 
Philadelphia. In the experimental group systematic Instruction In 
reading was delayed until the child was considered ready. The first 
group began reading Instruction after five months of readiness work; 
the second group, after eight months; the third group, after ten 
months. The control group started with reading Instruction In the 
first month of the first grade. Early In the second grade the control 
group was well ahead. But by the end of the second grade the experi- 
mental group equalled the mean scores of the control group, and by the 
end of the third grade the differences, although not statistically 
significant, tended to favor the experimental group. 

Two of the 27 cooperative research studies In first-grade read- 
ing supported by U.S.O.E. during 1964-65 dealt specifically with the 
effects of reading readiness programs. One of them, conducted In 
Texas (Horn, 1966) dealt with Children of Spanish-speaking background 
and therefore Is not directly relevant to the present study. A 
Florida study (Spache, 1966) Investigated the effects of reading 
readiness programs In eight Florida counties , In parallel white and 
Negro schools. Readiness tests were administered four times during 
the year and reading achievement tests were given in May. Pupils In 
the top quarter of the experimental groups were Inducted Into reading 
In September. The second quarter started reading in November, the 
third quarter in January, and the bottom quarter In March. The con- 
trol groups were started In reading In September regardless of readi- 
ness scores. Specific materials to develop visual and auditory per- 
ception were used In the readiness groups, and teachers were given 
recoomendatlons about the readiness needs of Individual children as 
revealed In ::he test scores. . "The program seemed to have an insig- 
nificant effect upon those pupils who were mature enough to read early 
In the school year, who hence participated In It only to a limited ex- 
tent. The effectiveness of the program appeared to Increase as the 
ability levels of the pupils decreased. . . For the Negro sample, the 
experimental treatment was significant for criterion achievement for 
the two lower quartlles only, but the nonsignificant differences 
favored the experimental treatment at all levels of ability. . . The 
Negro experimentals exceeded the \dilte experimentals In reading . 
achievement by a significant amount at the next to lowest quartlle 
and by nonsignificant amounts at all other levels." The. implication 
Is that Intensified and extended readiness programs deserve further, 
tryout, particularly for the lower half of Negro pupils. 

2. Beginning Reading Instruction for the Disadvantaged 

The beneficial effects of improved first-grade conditions other 
than teaching method have been reported In a study .from Philadelphia 
(Johnson & Kress, 1965). An l^ucatlonal Improvement Program was con- 
centrated in the first-grade classes of 61 elementary schppis with 
low mean scores on standardized achievement and Intelligence tests. 
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Class size was reduced, part-time classes were eliminated, experi- 
enced teachers were drawn from other grades when no experienced 
first-grade teachers were available, funds for materials were in- 
creased, and special consultants were provided. The reading scores 
at the end of 1963-64, the first year of the program's operation, 
showed substantial gains over scores obtained in the same schools 
in 1962-63. 

The More Effect5.ve School Program in New York City has received 
much publicity. Starting in September, 1964, with ten elementary 
schools, the program has Involved small classes, extra teaching per- 
sonnel (four teachers for three classes), and many supportive staff 
such as remedial teachers and counselors. In 1966 average class size 
was 20.1, compared to 28.5 in control schools. Approximately three 
quarters of the pupils are Negro or Puerto Rican. For the ten origi- 
nal MES schools the unit cost per pupil for instruction was $898.63 
in 1966-67, compared to $485.68 in control schools (Fox, 1967). 

An evaluation performed under the auspices of the Center for 
Urban Education came to the conclusion chat community relationships, 
school climate, and staff attitudes were good; but that "the MES pro- 
gram has made no significant difference in the functioning of chil- 
dren, whether this was measured by observers rating what children did 
in class, and how they do it, or whether it was measured by children's 
ability in matb> 3 inatics or reading on standardized tests." (Fox, 1967, 
p. 121) One must conclude that small classes,' extra teachers, and 
other expensive innovations do not necessarily improve classroom 
learning; they make Improvements possible, but changed classroom pro- 
cedures that take advantage of the smaller teacher-pupil ratio are 
needed . 

In contrast to the emphasis in the above studies on such factors 
as lower class size, full school days, and experienced teachers, 

CRAFT 1 attempted to study the specific effects of differing methods 
of instruction under conditions typical for first grades in the schools 
in which the 'project aerated. It did provide consultation for the 
teachers and some a. ^ i.f ication of materials . But class size was not 
diminished, teachers were not selected for excellence or experience, 

in three overcrowded schools the CRAFT 1 classes had shorter, 
split- session schedules along with the other first-grade rooms. 

Within the 27 cooperative first-grade studies there were two 
besides CRAFT that used populations of disadvantaged children and 
studied the effects of teaching method. 

In the City College project (Chall & Feldman, 1966) intensive and 
prolonged observations were made in first-grade classrooms, but no 
control was attempted over teaching methods or procedures. "There was 
some evidence that teacher competence, a thinking approach to learning. 
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a sound-symbol emphasis In reading, and using appropriate level of 
lessons were positively related to reading achievement for this par- 
ticular sample of children and teachers. . . A discrepancy was 
found between what teachers said they do In first-grade reading and 
what they were observed to do In their classrooms." Since all of 
the teachers In the study used an eclectic basal reader approach, 
the variations studied by Chall and Feldman would seem to correspond 
to the variations within the Basal Reader Method In CRAFT. 

In Colorado a study was conducted (McCanne, 1966) In which 
Spanish-speaking children were taught by three methods: (1) a con- 

ventional English readiness and basal reader method; (2) a. modified 
"Teaching English as a Second Language" method; and (3) a language- 
experience method. Thus, two of McCanne *s methods corresponded to 
methods used In CRAFT. Tiie teachers were all experienced and rated 
as excellent. The main conclusion was that the basal reader method 
was ahead on most of the tests given near the end of the first grade. 
McCanne speculated that "certain <^iyilturally determined thinking and 
behavior patterns, such as an unwillingness to Initiate original ex- 
pression In a formal school setting, may have been partly responsible 
for the superiority of the basal reader method In developing reading 
skills." 

Summaries of the 27 studies were published In the May and 
October, 1966, Issues of The Reading Teacher and have been reprinted 
as a paperback (Stauffer, 1967). A lengthy and detailed analysis of 
the cooperative studies h$s been published by the Coordinating Center 
at the University of Minnesota (Bond and Dykstra, 1967) . In the chap- 
ter entitled, "Analysis of Instructional Methods," one finds that only 
15 of the 27 projects were Included 'l)ecause they utilized a sample 
vdilch was considered to be representative of the total population and 
an experimental program which was also used In another Investigation." 
(Bond & Dykstra, 1967, p. 63). Thus CRAFT 1 and the McCanne project 
were not among the 15 because they used untypical populations. 

The Bond and Dykstra report does, however, contain descriptive 
statistics on all of the 27 projects. Including CRAFT, in Appendix A. 
So far as the results of their analysis of CRAFT 1 data are concerned. 
It needs to be mentioned that their tabular presentation of Stanford 
results on page A-23 unfortunately Interchanged the results for the 
Basal Reader and Phonovlsual methods, and that the means presented In 
that Appendix are uncorrected means based on Individual pupils, where- 
as In the CRAFT 1 report major emphasis was given to classroom means 
as units corrected by covariance. 

In both the McCanne and CRAFT 1 projects the basal reader results 
were somewhat better than the language-experience results. In the 
four projects with predominantly middle-class children, "Relatively 
few significant differences were found between the Language-Experience 
and Basal approaches. . . Little was found In this analyses to sup- 
port a claim of superiority by either the Language Experience or Basal 
Method" (Bond & Dykstra, 1967, p. 108). 
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A similar disparity occurred in the comparison of basal reader 
results with basal program plus a supplementary phonics program. 

The Coordinating Center combined the results of four projects and 
concluded: "In general, basal programs accompanied by supplementary 

phonics materials led to significantly greater achievement in reading 
than did basal materials alone" (Bond & Dykstra, 1967, p. 94). In 
the CRAFT 1 results only two of the differences between the BR Method 
and the PV Method (basal plus phonics) were statistically significant, 
and those (Stanford Paragraph Meaning, and San Diego Pupil Attitude 
Inventory)both favored BR. 

Thus In the first-grade comparisons the McCanne and CRAFT 1 pro- 
jects found the basal reader method somewhat ahead of the language 
experience method with two disadvantaged but otherwise quite different 
populations, vdille with more representative populations the two methods 
were about equal. In CRAFT the basal reader method showed a slight 
advantage over basal reader plus phonics, while In the more represen- 
tative populations supplementary phonics came out with some advantage . 

These results Indicate that the Instructional procedures most 
effective with disadvantaged children are not necessarily the ones 
most effective with the majority of first-grade children. They sup- 
port the desirability of research to find Instructional methods that 
may be suited to a particular disadvantaged group. 

A detailed analysis of Instructional time as a factor Influencing 
first-grade reading has been made, using the results of the CRAFT Pro- 
ject (Harris & Serwer, 1966, c). The results of that study have been 
summarized In Chapter I above. The authors pointed out that In com- 
parative studies of methods In which time Is not effectively controlled 
and recorded. Instructional time may be a major uncontrolled variable 
and the validity of Inferences drawn about relationships between meth- 
ods and results may be somewhat ambiguous. 

An Important comparative study of reading methodology with dis- 
advantaged urban children Is one In which the Initial Teaching Alpha- 
bet (1/t/a) and the Peabody Language Development Kit (PLDK) were used 
In 32 first-grade classrooms In Nashville (Dunn & Mueller, 1966). 

Most of the children were Negro, since six of eight experimental 
schools and three of five control schools were segregated Negro 
schools, and the other schools were Integrated. The findings Indicated 
that 1/t/a produced significantly better reading achievement than the 
basal readers used In control classes, and PLDK-had a favorabl e ef fect 
on IQ and oral language but not on reading. 

Unfortunately the study design was such as to enhance the moti- 
vation of the experimental teachers, while "In contrast, the control 
teachers were not stimulated or supported In any way by the project" 
(Dunn & Mueller, 1966, p. 12). This Inequality of Hawthorne Effect 
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was recognized end reported by the authors, and a replication was- 
planned for 1965-66 to control more completely for Hawthorne Effect. 
Another source of ambiguity in the interpretation of results is the 
absence of any information, in the report, concerning control of 
instructional time or teacher variability. 

In the Dunn £ Mueller report no mention is made of any readi- 
ness period preceding reading instruction, so presumably reading 
instruction began at the beginning of the school year in the experi- 
mental classes. If there was a readiness period in the contro). 
classes (no information is given about the instructional program in 
control classes other than the name of the series used) this might 
be another uncontrolled variable in the study. 

Despite these problems of research design, the Nashville pro- 
ject is of great Importance in demonstrating that groups of disad- 
vantaged first-grade children with mean IQ’s in the 80 *s can, under 
favorable instructional circumstances, attain mean reading scores at 
or above the national norm. Even the control classes in the study 
had a mean reading grade score of 1.81, just about at the norm. 



The Dunn & Mueller project also points out an alternative to 
the long readiness period rciported favorably in the Bradley and 
Spache studies. The PLDK p7rogram may be regarded as a kind of readi- 
ness program, and produced favorable results when given in parallel 
with reading instruction rather than prior to it. 

A second study was carried out by the Nashville group (Dunn 
et al, i967). Three experimental reading methods were used: Cl) 

i/t/a; (2) Words in Color; and (3) basal reader (Houghton Mifflin) 
plus phonics program (Hay-Wingo) . Each method was planned for use 
(1) by itself; (2) with one year of PLDK; and (3) with two years of 
PLDK; making nine experimental groups. In addition, there was a con 
trol group with no experimental procedures nor objectives. 



The control group did as well in reading as the experimental 
groups combined; within the experimental groups the basal reader plus 
phonics group did slightly better (at the .10 level) than i/^a or 
Words in Color, girls did better than boys, and those without PLDK did 
better than those with PLDK. The mean grade scores for the entire 
population were: Word Knowledge, 1.6; Word Discrimination, 

Reading, 1.5. These results were by no means outstanding and fell far 
short of the means of 2.0 in Word Knowledge, 2.3 in Word Discrimina- 
tion, and 2.0 in Reading reported in the earlier study (Dunn & Mueller, 
1966) . This second study is to be carried through the third grade and 
only first-grade results are available at present. However, it is evi- 
dent that none of the experimental reading methods in the study pro- 
duced significantly better results than those of the control group 
using conventional basal readers . 
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3, Cooperative Studies in the Second Grade 



Thirteen of the 27 projects In the U.S.O.E. cooperative first- 
grade studies of 1964-65 were funded for a second year, and two other 
projects continued on their own, making a total of 15. Of these, 
only ten were Included In the analysis made by the Coordinating Center 
at the University of Minnesota. "These particular ten projects were 
Included because they utilized a sample which was considered to be 
representative of the total population and an experimental program 
which also was used In another Investigation. Th^. establishment of 
these two criteria eliminated atypical populations such as those com- 
prised of potential disabled readers or Spanish-speaking youngsters 
as well as projects which Included a treatment or program not rep).l- 
cated in another project." (Dykstra, 1967, p. 40) The CRAFT Project 
was one of the five not Included in the Dykstra report. The conclu- 
sions arrived at In that report are not based In any way on CRAFT 
results and do not necessarily apply to the CRAFT population nor to 
similar populations. 
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CHAPTER III 



SECOND GRADE CONTINUATION PROCEDURES 
1, The Schools 

The 12 schools in CRAFT 1 were selected on the basis of the fol- 
lowing criteria: (1) designation as a Special Service school; (2) 

minimally 85 per cent non^hlte population In first grade; (3) a mini- 
mum of five and maximum of nine first-grade classes; (4) assurance of 
full cooperation from the district superlntenderit and school princi- 
pal; (5) willingness of four first-grade teachers to take part In the 
study; and (6) location of the school within the area covered by one 
of the four reading consultants Involved In the study. Of the 12 
schools, two were located In the Harlem section of Manhattan, six 
in the Bedford Stuyvesant section of Brooklyn, and four in the South 
Jamaica section of Queens. 

On the third-grade city-wide reading test given in the spring of 
1963, the median scores for these schools in Reading Comprehension 
ranged from 2.6 to 3.4. Median Income In their census tracts ranged 
from $1,980 to $7,035 per family, with the Income for the median 
sciiool at approximately $3,800. Median education for adults In the 
school neighborhoods ranged from 8.6 to 11.5 years, with a median at 
9.0 years. 

Three of the schools received unexpectedly large first-grade 
populations In September 1964, and had to place their first-grade 
classes on a four-hour (8 A.M. to 12 Noon) session, so as to accom- 
modate another group of classes In the afternoon. The first-grade 
statistical analysis had shown the pupils In these schools to be at 
a disadvantage as compared with pupils In the nine full-session 
schools, and the final comparisons were therefore made on full- 
session classes only. 

Eleven of the original 12 schools continued In the CRAFT study 
through CRAFT 2. All of these 11 schools were able to provide full 
session schedules In the second grade. The one school that dropped 
out was one of the three that had been on a split-session, four-hour 
schedule In the first grade. The principal reported that he was 
unable to enlist second-grade teachers for the study. The distribu- 
tion of the four teaching methods among the 11 remaining schools Is 
shown In Table 3.1. Seven of the schools had four second-grade classes, 
two had three classes, and two schools had two classes each. There 
were 20 Skllls-Centered classes and 18 Language-Experience classes, 
continuing the first-grade teaching methods as follow: 10 BR; 10 PV; 

9 LE; and 9 LE-AV. The total number of second-grade classes was 38, 
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as compared to 48 In the first grade. The perfect symmetry of the 
first-grade design was somewhat disrupted, but the methods continued 
to '>e applied In schools to which they had originally been assigned 
on a chance basis. It was hoped that any differences among schools 
would be cancelled out by the facts that each teaching method con- 
tinued to operate In several schools, and each of the 11 schools had 
at least one SC class and at least one LE class. 



2. The Pupils 

In CRAFT 1 the number of pupils completing the pretests was 
1,378 and the number also completing the post tests was 1,141, a loss 
of 17.2 per cent. Further shrinkage of the experimental population 
by pupils transferring out of CRAFT schools took place during the 
remaining weeks of the first grade, over the summer, and during the 
second grade. By the beginning of the second grade the experimental 
population was about 900. The number of original CRAFT pupils who 
remained In their classes until the completion of the CRAFT 2 post- 
tests was 656, only 57.5 per cent of the final CRAFT 1 population, 
and only 47.6 per cent of the population that took the first-grade 
pretests. However, a significant part of this loss was due to the 
loss of one school. In the remaining 11 schools, 63.1 per cent of 
the final CRAFT 1 population remained through the CRAFT 2 posttests. 
The total losses by school and borough Is shown In Table 3.2. The 
losses from CRAFT 1 posttests to CRAFT 2 posttests are shown In 
Table 3.3. 

As children left the CRAFT classes they were replaced by new 
entrants. By the completion of the CRAFT 2 posttests fewer than two- 
thirds (61 per cent) of the pupils In the CRAFT 2 classes were "CRAFT 
children" (children \dio had taken the first-grade pretests and post- 
tests). In Table 3.4 one can see that the per cent of CRAFT children 
was highest (70.8 per cent) for PV, and was considerably above the BR, 
LE, and LE-AV methods. The high percentage remaining In FV gave the 
SC Approach a higher percentage (64.5) than the LE Approach (57.1). 

Comparison of CRAFT 2 with CRAFT 1 Population 

Since 37 per cent of the CRAFT 1 children had left their schools 
before the CRi^ 2 final testing. It Is Important to compare the 



*At the beginning of the year there had been 40 experimental 
second-grade classes. However, two teachers who took leaves eatly In 
the year could not be replaced except by temporary substitutes and 
their classes had to be dropped from the project, leaving 38 classes. 
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remaining 656* with the original 1,141 to see whether or not the . 
remaining group is a reasonable sample of the original group. The 
data bearing on this question are shown in Table 3.5, for the CRAFT 1 
pretests and posttests. 

Comparisons were made for the four readiness tests on which 
scores were available for all classes. On three of the four pretests 
the differences slightly favored the CRAFT 2 population but were not 
statistically significant. On the fourth (Murphy-Durrell Learning 
Rate) there was a significant difference favoring the CRAFT 1 popula- 
tion. 



On the posttests there were small differences in favor of the 
CRAFT 2 population on all five Stanford subtests, but only one dif- 
ference (Word Study Skills) was statistically significant. 

Out of nine comparisons, then, only two differences were statis- 
tically significant, and of these one favored the CRAFT 1 population, 
while the other favored the CRAFT 2 population. Both on pretests and 
on first-grade posttests, most of the differences were within the 
range of chance variation. 

It seems safe to conclude, therefore, that the 656 CRAFT 2 chil- 
dren were a representative stsnple of the CRAFT 1 population. What- 
ever the reasons were for some children remaining and others leaving, 
the second-grade population does not seem to have been biased toward 
either more capable or less capable readers. Like the first-grade 
population, the second graders tended to cluster between the 20th 
and 25th percentiles on the national norms of the readiness pretests, 
and their mean achievement was at grade 1.5 on the Stanford Primary I 
Battery^ at a time when average achievement would be 1.8. 

CRAFT and Non-CRAFT Children 

As CRAFT pupils left their classes during the first and second 
grades th^ were usually replaced by new entrants, children recently 
arrived in the neighborhood. The second-grade classes tended to be 
slightly smaller than the first-grade classes had been; the mean num- 
ber per class who took the GRAFT 1 pretests was 28.7, while the mean 
number per class who took the CRAFT 2 posttests was 25.7. 

Data on class size for the two approaches and four methods are 
shown in Table 3.6. Most classes had between 20 and 30 children; 
there were two classes with fewer than 20 , and three classes with 
more than 30 pupils. The mean size was lowest for LE, mainly because 
one class had only eight children present on the day the city-wide 
reading test was given. The SC classes averaged 2.3 children more 
per class than the LE classes. Of the 1,006 children who took the 



*The number varied slightly as some children had been present 
for one test but absent for another. 
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CRAFT 2 post tests, 656 were CRAFT children. The remaining 350 were 
”non-CRAFT”; they had entered experimental classes at varying times, 
but always after the CRAFT 1 pretests had been given. These non- 
CRAFT children were given the Metropolitan posttests, but were not 
included in the major statistical analyses. 

Data on the distribution of CRAFT and non-CRAFT children who 
took the CRAFT 2 posttests are given in Table 3.7. Some classes 
(particularly those formed by consolidating the CRAFT children from 
two first-grade classes into one second-grade class) had very few 
non-CRAFT children; others had a majority of non-CRAFT children. The 
mean number of non-CRAFT children per class was highest (10.4) in the 
BR Method; lowest (7.9) in the PV Method. 

The number of CRAFT 2 classes in which the non-CRAFT children 
outnumbered the CRAFT children was five, distributed as follows: 1 BR, 
0 PV, 1 LE, and 3 LE-AV. The CRAFT children were outnumbered, then, 
in only 1 of 20 SC classes, but in A of 18 LE classes.* 

Distribution of Bovs and Girls 

The number of CRAFT 2 boys and girls was nearly equal, whether 
the comparison is for the total population, for the two approaches, 
or for each of the four methods. The results are shown in Table 3.8. 
The classes had been assigned equal numbers of boys and girls at the 
beginning, and apparently both sexes had approximately equal numbers 
of transfers. Of the 656 CRAF’" 2 children, 331 were boys and 325 were 
girls. The only method which had a slightly higher number of girls 
was BR, and like the other comparisons in Table 3.8, the difference 
was not significant. 

3. The Teachers 



Selection of Teachers 

In CRAFT 1, teacher selection was based in part on willingness 
to accept either of the methods assigned to her school. In the spring 
of 1965 some of the principals indicated that if they adhered strictly 
to this policy, they would not be able to recruit a sufficient number 
of CRAFT 2 teachers. The project’s statistical consultants were asked 
to advise on this matter, and they decided that it would be better to 
allow some leeway for teacher preferences than to lose classes. Ac- 
cordingly, principals were advised to assign teachers to the variables 
in a chance fashion, but to allow a teacher to choose one of the two 
methods in that school if ohe insisted that she would not enter the 
project otherwise, and if no other qualified teacher was avaUable. 

In some schools, teacher preference influenced the second-grade assign- 
ments to methods; in others it did not. 






29 



As In CRAFT 1, principals were asked to try to select teachers 
who were regularly licensed and who were unlikely to leave the class 
before the May testing would be completed « They were requested to 
encourage teachers to participate, but not to use pressure. A repre- 
sentative group of teachers, rather than a superior group of expert 
teachers, was desired. 

In the 11 participating schools, 38 teachers were assigned to 
the four methods. These teachers varied greatly In age and teaching 
experience. 

Data on age of teachers are shown In Table 3.9. The range In 
age for the whole group was 21 to 60, and was almost as large In 
each of the four methods. The two approaches were quite close In 
both mean age and median age. However, the means for the four meth- 
ods range from 31.6 to 42.6, and the medians range from 27.0 to 50.5. 
The BR teachers were the oldest group, followed by LE, PV, and LE-AV. 

Educational levels of participating teachers are shown In 
Table 3.10. The two approaches are seen to be quite evenly balanced, 
and the differences among the four methods are small. All the 
teachers had bachelor's degrees, and a majority had taken some grad- 
uate work. Seven had master's degrees, and three of these had com- 
pleted some work beyond the master's degree. 

In total years of teaching experience the two approaches were 
quite comparable; the SC Approach teachers had the higher mean, 
while In the LE Approach teachers had the higher median. These data 
are summarized In Table 3.11. However, there were teachers with no 
prior teaching experience in the BR and LsS-AV Methods, and the LE-AV 
teachers, whose median was only two years of total teaching experi- 
ence, definitely were the least experienced. The greatest variabil- 
ity In years of experience was In the BR method. 

Specific second-grade teaching experience Is shown In Table 
3.12. It can be. seen that the teachers as a total group had rela- 
tively little prior experience In teaching second-grade classes, 
with the means and medians for the four methods all falling between 
1.0 and 3.33 years. All four methods had some teachers with no pre- 
vious second-grade experience. Again the LE-AV teachers were least 
experienced, with a median of only one year in the second grade. The 
LE teachers were most experienced, followed In order by the PV teach- 
ers and BR teachers. 



4. The Program for the Year 

Before the school year started there were two workshop sessions, 
a short one on June 15, 1965 and an all-day session on September 9, 
1965, at which all CRAFT 2 teachers were given an overview of the 
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project and separate meetings were held for the four instructional 
methods. The workshop continued through the experimental period; 
details will be found in Chapter IV. 

The teachers were requested to begin reading instruction on the 
first day of school (September 13, 1965) and to introduce the special 
features of their methods as soon as possible. Instruction was to 
continue for 140 instructional days, after which the posttests would 
be administered. The posttests were scheduled during the third week 
of April, 1966 which happened to fall shortly after the Spring vaca- 
tion. 



During the year the planning committee met regularly , usually 
for a three— hour session once a month. This committee Includtid the 
director and assistant director, the four reading consultants, the 
early childhood consultant , and the audio-visual consultant (when 
available). At these meetings plans were made for coping with spe- 
cial situations that arose from time to time, workshop and supervisory 
activities were planned and revised, new materials were reviewed and 
^recommended for purchase, and plans for the testing program were made. 

The details about the teaching methods and the training and 
supervisory procedures will be found in Chapter IV . Details about 
the evaluation program and experimental precautions and controls will 
be found below. 

5. Measurement and Evaluation Procedures 

During CRAFT 1 the tests used were those agreed to by the coop- 
erating project directors and set forth in directives from the Coor- 
dinating Center at the University of Minnesota. By the fall of the 
second grade it was evident that there were good reasons why CRAFT 2 
should deviate in certain respects from the testing program set for 
the continuing second-grade projects. The reasons follow. 

1. The Stanford Primary I. Battery had shown itself to be very 
difficult and frustrating for the CRAFT 1 pupils, and it was 
feared that the Stanford Primary II would be equally dis- 
heartening for them. 

2. :^e CRAFT 2 population was sufficiently different from the popu- 
lations of the other continuing studies that. few meaningful com- 
parisons, if any, would be possible even if the same tests were 
used. 

3. It was known that the New York City public schools were planning 
to give a special machine-scored edition of the Metropolitan 
Primary II Reading Test to all second-grade classes. This test. 
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the Metropolitan Advanejsd Primary, Form C, consisted of the 
Word Knowledge and Reading subtests of the Metropolitan Primary 
II, It has special New York City norms, which for the most 
part are one month more lenient than the national norms, 

4, Using the city-wide test would cut down the amount of addi- 
tional testing necessary. 

At a meeting of project directors In Minneapolis In December 1966 
these reasons were presented and permission was received to use the 
Metropolitan Instead of the Stanford tests. 



l!he Tests Used 

1, As explained above, the two sub tests of the Metropolitan Ad- 
vanced Primary, Form C, were administered with separate answer 
sheets in all CRAFT 2 classes on the city-wide date. The tests 
were administered by the school's Corrective leading Teacher 
with the classroom teacher assisting; In the rest of the city 
these tests were administered by each second-grade teacher to 
her own pupils. The answer sheets were sent to Harcourt, Brace 
and World Co, for machine scoring. An extra fee was paid In 
order to obtain raw scores for each pupil, 

2, Copies of the Metropolitan Primary II Battery hand-scored edi- 
tion were obtained and the three remaining sub tests (Word Dis- 
crimination, Spelling, and Arithmetic) were administered In 
the same week by the Corrective Reading Teacher with the class- 
room teacher assisting. These booklets were collected and 
scored by the project's research staff. 

The Word Knowledge sub test evaluates the pupil's vocabulary 
words and consists of two parts; one presents a stimulus plc^ 
ture and four words, one of which corresponds to the accom- 
panying picture; the other evaluates the student's ability to 
select a synonym for a stimulus word presented In an Incomplete 
sentence, with four choices. The Word Discrimination test 
examines the ability of the testee to correctly Identify one 
of four words read orally by the test administrator. All four 
choices presented to the student are similar In configuration. 
The Reading sub test Is divided Into two parts, one dealing with 
sentence reading and the other with story reading, both of 
which are designed to measure elements of comprehension. The 
Spelling sub test Is conventional to the extent that the chil- 
dren write words which the examiner dictates from a spelling 
list. The Arithmetic subtest Includes Items related to con- 
cepts, problem solving, and computation. 
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3. Tlie San Diego Inventory of Pupil Attitude was administered 

as a group test by the Corrective Reading Teacher. After she 
read each item to them, pubils responded by marking "Yes” or 
a "No." 

4. A group of Individual tests was administered to a random sam- 
ple of four children per class by the reading consultant for 
that school. These tests were: 

a. The Gilmore Oral Reading Test, Form B. This test was 
scored for Accuracy (expressed as a grade score) and Rate 
(In terms of words per minute) . Scoring was done by the 
research staff. Two comprehension questions were asked 
after each selection, but comprehension was not scored. 

All timing was done with a stop-watch. 

b. The G^es Word Pronunciation Test. The 40-word list was 
administered as an un timed test and scored for number 
right, following directions distributed by the Coordi-' 
natlng Center. Grade norms were obtained from the Manual 
for the Gates Reading Diagnosis Tests, 1945 Edition. 

c. The Fry List of Phonetically Regular Words was adminis- 
tered and scored following directions distributed by the 
Coordinating Center. 

5. Writing Samples were obtained using the procedure agreed on by 
the project directors and distributed by the Coordinating Cen- 
ter. An Incomplete story prepared by Dr. A. J. Mazurkiewicz 
was read by the teacher to the class, and the children were 
asked to write their own endings to the story. This was ad- 
ministered in each class by the classroom teacher. It was 
scored only for the sample of four children per class who were 
given the Individual tescs described above. The Writing Sam- 
ples were scored, according to directions received from the 
Coordifiating Center, for (1) Mechanics; (2) Number of words 
spelled correctly; and (3) Number of running words. 

6. During one calendar month (February 15 to March 14) each 
teacher was asked to keep a record of the books read inde- 
pendently by each child. There were 19 school days during this 
period. Each book read was recorded on a special form, fol- 
lowing directions from the Coordinating Center. The reports 
were totaled for each child and class by the research staff. 
Separate counts were made for: 

a. Books read completely 

b. Books read partially 
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7. A Second-Grade Reading Interest Scale distributed by the Coor- 
dinating Center was filled out by each teacher (See Appendix) . 
On this form each child was rated for: 

I 

i 

I a. Eagerness to read 

b. Maturity cf reading choices 

8. The Dally Log Form . To check on actual use of Instructional 
tlme^ a Dally Log fo.tu .sod. Teachers were asked to fill 
this out for five consecutive teaching days (usually the third 
week) In each of five months. Host of the teachers supplied 
the full 25 Logs requested. The mean time per day was ob- 
tained for each teacher. The form used In GRAFF 2 was adapted 
so that It could be read by an IBM 1230 Optical Scanner. The 
1230 punched the data Into cards, which could then go to the 
computer. A copy of the Log form will be found In the Appen- 
dix. 

The Log resulted In the following scores: 

Total Instructional Time 
Total Reading Time 
Total Supportive Time 
Six Reading activities: 

basal reader activity, experience chart, sight 
word drill, phonic activity. Individualized reading, 
other reading activities (specify) 

Eleven supportive activities: 

listening to stories, listening to poetry, discussion, 

I writing, dramatization, art work with reading, audio- 

visual activity, audio-visual with discussion, other 

j language arts (specify), social studies and science. 

i 

I 

i 

The CRAFT 2 teachers were Informed at the beginning of the year 
that variations In Instructional time had been found to be 
Important ijn the CRAFT 1 results, and repeated emphasis was 
given to the Importance of staying close to the recommended 
time allotment and keeping accurage Logs. 

9. CRAFT 2 teachers filled out the San Diego Teacher Inventory of 
Approaches to the Teaching of Reading test twice, once at the 
beginning of the academic year and again at the end of the 
year. These are referred to as the pretests and posttests. 
There are three scales In the test, Basic, Individualized and 
Language Experience. Teachers taking the test react to state- 
ments concerned with the philosophy exemplified In the various 
components of reading Instruction associated with each of the 
three scales. Each scale Is based on specific items. A high 
score on the Basic Scale corresponds to agreement with the 

BR Method, and high scores on the agreement with Individu- 
alized or Language Experience Scales relate to an acceptance 
of the principles associated with those programs. Thus, the 
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ban Diego Inventory includes scales providing for a measure 
of a teacher's attitude toward the major approaches in this 
study, although it precludes an estimate of the teacher's 
opinions relating to the PV and LE-AV Methods. In inter- 
preting the results of the SD Inventory, scores falling with- 
in a range of 11-22 Indicate disagreement with the factors 
measured by the scale, 22-33, a tendency to disagree, 33-44, 
a tendency to agree, and 44-55, agreement. 

10. The OScAR R . The Observational Schedule and Record-Reading 
(OScAR R) was developed by Dr. Donald M. Medley with the 
assistance of Lou Hicks Smith, specifically for use in the 
CRAFT Project. The purposes for which it was designed were: 

(1) to provide an objective record of differences in methods 
and materials among the instructional methods; (2) to yield 
information about similarities and differences in the behav- 
iors of teachers assigned to the same method; and (3) to make 
it possible to find out if these differences are^ related to 
pupil achievement in reading. 

The schedule has two parts, "Static" and "Dynamic." The 
"Static" part is a record of the materials and teaching meth- 
ods used by the teachers. The "Dynamic" part is a record of 
the pattern of teacher statements and of the verbal inter- 
changes between teacher and pupils. The categories and pro- 
cedures were designed to Involve only simple, non-evaluatlve 
discriminations which could be made by relatively unsophisti- 
cated observers after a brief period of training. 

Each observation consisted of three ten-minute periods. During 
the first three minutes of each period the observer noted the 
materials used (basal, pupil produced, teacher produced; chart, 
chalkboard, writing materials, A-V equipment, etc; whether the 
teacher was working with an individual pupil, a group, or 
entire class; and what kind of activity she was leading). 

These items were tallied on the "Static" side of the record 
card. During the next seven minutes the observer tallied, on 
the "D 3 mamic" side, the kinds of teacher statements and teacher 
responses to pupil statements. A copy of the Instructions for 
Recording Behavior with OScAR R and the record card used may 
be found in the Appendix. 

Thirteen scoring scales were developed for OScAR R. Eight of 
these were based on the "Static" side and were intended to 
check on the existence of real differences among the teaching 
methods. The first six of these were labeled "empirical" be- 
catise they were derived from a fourth ten-minute observation 
and were based on the observed lessons for the four methods. 

The first of these empirical scales gave weight to activities 
stressed more by LE teachers; the second, to activities 
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stressed by SC teachers. The third and fourth scales 
applied only to LE teachers and highlighted the special 
features of the LE-AV Method as distinguished from the regu- 
lar LE Method. The fifth and sixth scales were used only 
within the SC Approach to distinguish between the BR Method 
and the PV Method. There were also two "A Priori" scales 
that were developed by the project director based on his 
knowledge of what the teachers in the two approaches were 
supposed to do; one for LE procedures, the other for SC pro- 
cedures. These two scales were, then, a check on the valid- 
ity of the Empirical LE and SC scales. 

Five scales were based on the "Dynamic" side of OScAR R. The 
first, "Control," was based on the total number of times the 
teacher made statements to control pupil behavior. The 
second, "Positive Motivation," was based on the number of 
teacher statements Intended to praise, increase motivation, 
reduce tension, or make the child feel better. The third, 
"Negative Motivation," was based on the number of teacher 
statements livolvlng correction or criticism of pupil behav- 
ior, or In other words which tended to make the pupil feel 
bad. The fourth, "Total Interchanges," was based on the num- 
ber of pupil statements to \dilch the teacher made a verbal 
response. The fifth, "Per Cent of Meaningful Interchanges," 
differentiated between Interchanges concerned with meaning 
and Interchanges In which drill or memorization was Involved. 

These thirteen scales did not exhaust the possibilities of 
OScAR R, and there are sections of the record on which addi- 
tional scales could be based. They are, however, the only 
OScAR R scales developed and used In the Craft Project. 

Statistical Treatment 



The statistical operations were designed to be carried out on 
a relatively small computer, since the IBM 7094 used In CRAFT 1 was 
no longer available. The major part of the analysis was done on an 
IBM 1620. Many of the smaller analyses were computed on an Olivetti 
Programma 101, which proved to be very useful for analyses of vari- 
ance, for tests of significance, and for correlations based on small 
numbers of cases. 

In general the statistical treatment was similar In Its objec- 
tives to that used for the first grade, but differed In many details. 
The method for correcting for differences In Initial ability, and 
the method for separating second-grade results from first-grade re- 
sults, were adapted from Efroymson (1960). 
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The sequence of steps was as follows: 

1. During the summer of 1966 the coding of CRAFT 2 data was 
completed and data cards were punched. 

2. During the fall many weeks vere spent In checking and cor- 
recting the data cards. A rumber of errors were discovered 
and corrected, some In the coding, others In the punching. 

3. Means and standard deviations were obtained for the two 
approaches and four methods, for boys versus girls, for 
CRAFT and non-CRAFT children, etc. 

4. Class means on the CRAFT 2 Metropolitan subtests were ad- 
justed to eliminate the Influence of differences In the 
readiness of these children at the beginning of the first 
grade. This Involved a sequence of steps: 

a. A correlation matrix of 15 variables was computed. 

These Included : 

1-4 The four readiness tests given In October, 1964, 
and used as pretests In the CRAFT 1 analysis 
(Murphy-Durrell Learning Rate, Metropolitan 
Readiness Word Meaning and Listening, Thurstone 
Pattern Copying). 

5 Number of half-days of kindergarten. 

6 -10 The five sub tests of the Stanford Primary I, 

given as CRAFT 1 posttests In May, 1965. 

11 -15 The five subtests of the Metropolitan Primary 11, 
Form C, given as CRAFT 2 posttests In April, 1966. 

b. From an Inspection of these Intercorrelations (see 
Table 5.5 ) it was decided to use variables 1 - 4 as 
predictors in multiple correlation equations, with vari- 
ables 11 - 14 as the Y variables, in four separate equa- 
tions . 

c. Using these equations, a predicted score was obtained for 
each child on each of the Metropolitan II subtests. 

d. A mean predicted score was obtained for each class. This 
was subtracted from the obtained mean. The difference 
was then applied to the obtained mean to provide an ad- 
justed class mean. Thus, if the obtained class mean was 
22.0 and the predicted class mean was 20.0, the differ- 
ence was +2.0 and the adjusted class mean was 24.0. This 
procedure was followed for each of the Metropolitan II 
subtests. It was the equivalent of a multiple covariance 
procedure. 
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An analysis of variance was carried out for the three 
reading sub tests and the spelling sub test of the Metro- 
politan using the adjusted class means. In the analysis 
the two schools that had been on four-hour schedules In 
the first grade were "nested" to eliminate any possible 
Influence of this factor on the analysis. 

6. A similar procedure was followed for obtaining adjusted 
class means on the Individual tests given to a small sam- 
ple of four children per class, and these T'^ere also used 
In analyses of variance. 

7. The five Stanford Primary I scores (the CRAFT 1 posttests) 
were then used as the pretests In a multiple correlation 
procedure as described above, to obtain Metropolitan class 
means adjusted on the basis of CRAFT 1 posttests. This 
made It possible to eliminate the Influence of differences 
In first-grade reading achievement. It allowed a clearer 
picture of the results of the Instruction In the second 
grade . 

8. The adjusted means obtained In step 7 were used In analyses 
of variance, similar to step 5. 

9. A list of variables that might possibly have Influenced the 
results was drawn up. These Included Items like teacher age, 
education, experience, and attendance; neighborhood factors; 
pupil preschool experience and attendance; th<>. CRAFT 1 test 
results; the 20 scores based on Teacher Log^; and the 13 
scores from the OScAR R observations. These, plus the second- 
grade posttests, added up to 73 variables. An Intercorrela- 
tlon matrix was computed for this matrix. 

10. This matrix was Inspected for significant correlations with 
CRAFT 2 outcome measures, and each of the variables Identi- 
fied In this way was given special study. 

The statistical outline given above will be followed In presenting 
the results of the CRAFT 2 analysis In Chapter V. 



The Class or the Pupil as the Statistical Unit 

There Is a difference In practice concerning the proper unit 
to use when checking observed differences between treatments for 
statistical significance. In many research studies on primary reading, 
the Individual pupil has been used as the statistical unit. In other 
researches the mean for each class Is the chosen unit. Whether one 
uses the Individual pupil or the class mean makes a great deal of dif- 
ference. For example, 10 class means provide nine degrees of freedom, 
while 200 children in those classes provide 199 degrees of freedom. 
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Thus the siame difference may look highly significant when based on 
individual pupil scores, but fail to show significance when based on 
class means . 

The statistical consultants for the CRAFT Project strongly 
recommended that class means, rather than pupil scores, should be 
used in testing for significant differences. This practice, recom- 
mended by Campbell and Stanley (1963, p. 192), has been very clearly 
explained by Glass and Robbins (1967, p. 11): 

...when a treatment is applied to a group of subjects,, 

Instead of to each subject individually and Indeperdently, 
an appropriate analysis of the experiment uses the means 
of the groups as raw data. In such Instances, the legltl<» 
macy of the analysis on the scores of each individual is 
questionable since it gives the impression of far greater 
precision in the data than actually exists. The researcher 
should be guided by the following: the unit of analysis, 

l.e., the raw data upon which one counts up degrees of 
freedom must be the same as the experimental unit, l.e., 
the smallest subdivision of the total group of subjects 
which is randomly assigned to the experimental condition 
and which is treated Independently of other experimental 
units for the duration of the experiment. An appreciation 
of the Importance of determining the legitimate experimental 
unit and having it coincide with the unit of statistical 
analysis is not widespread in educational research. 

In the CRAFT 1 results, differences among teachers within each 
method were much greater than differences between methods. It seemed 
important, therefore, to retain the class as the statistical unit in 
the major analyses of data. This was done except in the CRAFT 3 
follow-up, in which classes no longer existed as experimental units. 

6. Experimental Precautions 
Avoidance of Hawthorne Effect 



As in CRAFT 1, an effort was made to avoid giving any group of 
teachers the idea that they were members of a control group; all 
four methods were treated as experimental methods. They had simi- 
lar workshop schedules, and had similar programs of visitation and 
consultation. As in CRAFT 1, most of the 6R and PV teachers had 
not previously followed a teacher's manual closely and doing so was 
a relatively new way of teaching for them. 

Equality of Provisions for Consultant Services 

Of the four methods, three were reasonably well provided for. 
The fourth method, LE-AV, suffered from interruptions of consultant 
services. The AV consultant who had been in the project through 
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CRAFT 1 resigned early in the CRAFT 2 year. There was a gap of 
several weeks until a capable person filled the role through January 
The position was vacant again from the first of February through 
March, after which a third AV consultant provided a few days of help 

This Interruption of AV consultant services was damaging. When 
AV equipment or supplies failed to reach the classrooms, the AV con- 
sultant was usually able to expedite matters; but when there was no 
AV consultant, such problems tended to remain uncorrected for weeks 
or months. In addition, some CRAFT 2 LE-AV teachers made relatively 
little use of the equipment provided because they had not received 
instruction in its operation and possible uses in teaching reading. 

The difficulties in providing AV materials and consultant help 
were made more serious by the fact, pointed out earlier in this 
chapter, that the AV teachers were the youngest and least experi- 
enced of the four groups. There is good reason to believe, there- 
fore, that the LE-AV method did not receive as good support as the 
other three methods during CRAFT 2. 

Instructional Time 

The same instructions about time were used as in the full- 
session CRAFT 1 classes. All second-grade classes were on full- 
session schedules, three hours in the morning and two hours after 
lunch. All teachers were Instructed to devote 180 minutes per day 
to instruction in reading and relatv^d supportive activities. 

For teachers in the Skills-Centered Approach (BR and PV) the 
following use of time was requested: 



The LE and LE-AV teachers were asked to devote the same total 
minutes to the combination of Language Arts, Social Studies, and 
Science. Since integration and mutual reinforcement of the language 
arts (listening, speaking, reading and writing) was a basic concept 
of the LE Approach, the balance of time between reading and the 
other language arts was left flexible, and Social Studies and 
Science were not tallied separately. 

The OScAR R 

The OScAR R (Observation Schedule and Record-Reading) is an 
objective way of recording teacher behavior described above in sec- 
tion 5. It had been used in the CRAFT 1 classes. 



Language Arts - Total 
Reading (3/4) 

Other Language Arts (1/4) 



120 minutes 



90 minutes 
30 minutes 



Social Studies 



Science and Health 



30 minutes 
30 minutes 



Total 



180 minutes 
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Each CRAFT 2 teacher was recorded on OScAR R four times, twice 
by each of two resea'rch assistants. There were fewer complaints 
about this procedure than in CRAFT 1 (where each teacher had been 
observed eight times , and complaints were many) , but several teach- 
ers reported that being observed in this way made them feel uncom- 
fortable. They were, particularly annoyed that they received no 
feedback from the observers. 

Effect of Teacher Familiarity with Method 

As in CRAFT 1, there was probably some inequality in the degree 
of familiarity with the assigned method. The BR Method was least 
different from previous practices. The PV Method involved an unfa- 
miliar method of teaching word recognition skills, but one provided 
with specific directions in a manual, and specific materials. The 
LE Method used small group and individualized reading procedures in 
second grade, relatively uncommon at that grade level. The LE-AV 
Method was probably least familiar. Whether experience in using 
these methods makes much of a difference has been Investigated in 
Replication 1 and 2. 
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CHAPTER IV 



METHODS OF INSTRUCTION IN THE SECOND GRADE 



1, Description of Teaching Methods 
Contrast of Approaches 

The SC Approach, as used in the CRAFT Project, represents an 
orderly and systematic approach in which the many skills and sub- 
skills involved in the reading process are presented to pupils in 
a carefully planned sequence. In this study the SC Approach incor- 
porated the Basal Reader Method (BR) and the Phonovisual Method (PV) . 
An essential element is the provision of a detailed teacher’s manual 
or guide which provides a step by step sequence of teaching activi- 
ties to be followed. An important characteristic of skill-centered 
programs is that ample provision is made for review and repetition. 

In the reading materials there is careful vocabulary control and new 
words are Introduced in a predetermined sequence. 

The LE Approach attempts to utilize the experiences of children 
as a basis for instruction in the various components of the language 
arts. Implicit iu this approach is the concept that children enter 
school with a wide range of experiences which may be utilized for 
the development of an Integrated instructional program which in- 
cludes oral communication, reading, writing, and composition. Daily 
experiences in school and at Lome, as well as those obtained vicari- 
ously, through filmstrips, recordings, or story-telling activities, 
may also serve as reference points for establishing an integrated 
approach to the deve’lopment of language arts skills. 

The LE Approach in this study incorporated the Language- 
Experience Method (LE) and the Language Experience Audio-Visual 
Method (LE-AV). 

Basal Roiftder Method 

The instructional plans set forth in the manuals of the basal 
readers used in this project are quite similar, although there are 
variations in terminology. There are, in general, four major divi- 
sions to the plan, and these are repeated with minor changes in the 
teaching of story after story. The four divisions are: (1) prepara- 

tion; (2) guided reading and rereading, silent and oral; (3) devel- 
oping specific reading skills; and (4) enrichment. 

Preparation . Preparation for a new story involves three steps. The 
first is motivation and arousal of interest. The second is the in- 
troduction and explanation of new concepts, ideas, and meanings. 

The third is oral and visual presentation and preteaching of the 
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new words in the story. The words are presented on the chalkboard, 
sometimes in sentences, sometimes in isolation. They are usually 
taught by a "look and say" procedure, although sometimes children 
are encouraged to apply word recognition skills previously taught. 

Guided Reading and Rereading . Before silent reading is started 
there is usually a brief discussion of the title of the story and 
the first Illustration in it. The teacher asks a question or two 
and the children read silently to find the answer. At second grade 
the amount read is often about a page. Discussion of the guiding 
question and of other questions follows the silent reading. Oral 
reading usually follows, for a variety of purposes: to clear up a 

disputed point, to find out how the characters feel, to find happy 
or sad parts, to prepare to draw an illustration, to make it sound 
as if the characters are really speaking, to prepare a dramatiza- 
tion of the story, etc. Often the selection is reread more than 
once. 

Developing Specific Reading Skills . Following the oral and silent 
reading the manual presents directions for the development of a 
variety of reading skills: word recognition practice, phonics, 

structural analysis, combining various skills in attacking words, 
various comprehension skills, etc. The plans in this section pro- 
vide for direct teaching of new skills and for reinforcement 
through use of the workbook. 

Enrichment . Many more enrichment ideas are usually provided than 
the teacher can find time to use. Language practice can Include 
jingles and rhymes intended to improve clarity of speech. Sugges- 
tions are made concerning stories which the teacher can read to 
the children, related songs and poems, dramatization, related art 
work and books and stories for Independent reading by the children. 

The CRAFT 2 classes which used this method had available basal 
readers at different grade levels (pre-primers, and 12, 2^, 2^, 
readers), workbooks which accompany these readers, cards which pre- 
sent words and phrases used in the stories, and the teacher’s 
manual for each of the readers. 

No attempt was made to use a single basal series in all the BR 
method classes which comprised the CRAFT 2 study. Rather, the 
readers used were those normally available to second grade teachers 
in the CRAFT schools. The basal programs available were predom- 
inantly the Scott, Foresman Basic Readers; Ginn Basic Readers and 
the Harper & Row Alice and Jerry Bo( ks were also used in some . 
classes. Several classes used the multi-ethnic edition of the Scott, 
Foresman Basic Readers in CRAFT 2 after having used the regular 
edition in CRAFT 1. 
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Although the BR Method was perhaps the most familiar to 
CHAFF 2 teachers, relatively few of them had fully utilized the 
procedures specified In the teacher's manual. An Important objec- 
tive of the training program for the BR teachers was to have them 
adhere closely to the manual In their Instructional procedures. 

All of the teachers In the BR Method Introduced the Instruc- 
tional program to the children on a group basis, rather than to 
the whole class. Most often, the children were divided Into two 
groups; some teachers used a three group system. 

A recurring problem which the teachers faced, and which was 
prevalent In the other second-grade classes In CRAFT schools, was 
providing meaningful seatwork for pupils In the "slow" group while 
the teacher worked with the "fast" group. At the second-grade 
level, pupils In the slower group may range from almost non-readers 
to those reading at the 1^ level. The number of books available 
ac this level which may be read Independently Is limited. Conse- 
quently unless the teacher was quite enterprising In providing 
alternate activities, this group might sit and simply observe the 
lesson being taught by the teacher to the other group. 

One of the objectives of the workshop for BR teachers was to 
avoid neglect of the parts of the manual lesson plans that follow 
silent and oral reading. During the workshop sessions with BR 
teachers the workshop leader provided many suggestions for follow- 
up activities. Each of the reading consultants attempted to 
strengthen this aspect of the BR Method during her frequent visita- 
tions to the classroom. 

The extent to which this general BR plan was utilized In each 
of the CRAFT classes varied, as one might expect, from teacher to 
teacher. Nevertheless, It was generally observed by the assistant 
project director, who visited each of the classes on a periodic 
basis, that all the teachers tended to follow this plan more and 
more as the study progressed. 

Phonovlsual Method 



The PV Method provides a highly structured phonics program. 

The manual (The Phonovlsual Method, by Schoolfleld and Tlmberlake) 
which described this program suggests that the Intensive teaching 
of phonics begin. If possible, the very first day of the first 
grade . The program Is Intended to supplement other reading Instruc- 
tion, and Is readily combined with the use of basal readers. 

In CRAFT 1 the Phonovlsual materials and procedures replaced 
only one phase of the BR Method. Instead of teaching phonics and 
structural analysis as suggested In the basal reader teacher's 
manuals, the Phonovlsual program was used to teach these skills. 

In all other respects, the PV Method was similar to the BR Method. 
Both used basal readers normally available at the second-erade 
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level, and implemented the various phases of the typical basal 
reader program, except that In the PV Method Its own unique phonics 
approach was utilized. 

The first-grade Phonovlsual Instructional program Includes two 
wall charts (one for consonants and one for vowels) , two workbooks 
(one for consonants and one for vowels), a teacher's manual, and a 
"game book" with suggestions for varying the reinforcement activi- 
ties. In addition, the program provides an asisortment of supple- 
mentary aids, such as Individual pupil copies of the consonant and 
vowel charts, "skill builders" (small cards each duplicating one 
phonic element contained on the wall charts), and "fllpstrlps" 

(cards which may be folded to expose either the stimulus picture or 
Its corresponding grapheme) . 

The Phonovlsual consonant chart contains twenty-six stimulus 
pictures In association with phonic elements. For example, there 

Is a picture of a pig, next to which Is, p, ; a picture of a wheel, 

next to which Is, wh Of the twenty-six phonic elements presented 
on the chart, nineteen are single consonants, six are consonant 
digraphs, and one Is a consonant vowel combination (qu) . 

The Phonovlsual vowel chart presents seventeen phonic elements, 
also In association with stimulus pictures. Ten of these phonic 
elements consist of the long and short vowels. The remaining seven 
Include vowel diphthongs (ow, oy) ; modified vowel sounds (aw , ur . ar) ; 
and two sounds of the digraph oo . 

The Instructional procedures are exactly specified. The Phonor 
visual consonant chart Is mastered first, one consonant at a time. 
After Initial teaching of the phonic elements. Intensive reinforce- 
ment activities are provided, mostly In the form of games and through 
the use of the various supplementary materials which are provided for 
each pupil (the workbooks, sklll-bullders , and fllpstrlps). 

Writing is initiated as soon as the children have shown ability 
to identify the first five consonant elements on the chart (p_, wh, f , 
th , ^). The writing activity consists of the teacher saying the one- 
syllable stimulus word, such as pig , while the pupils are taught to 

write first the Initial consonant (p ) and at a later stage, the 

consonants in their Initial and final position (p_g) . Many different 
words are used to develop in the children the facility to write the 
Initial and final consonants , leaving blanks for the vowels . The 
sounds are Identified by the picture cue; for example, £ is called 
"the pig sound." 

The Phonovlsual vowel chart is not Introduced until there is 
group mastery of ability to identify all the consonant elements. The 
lone £ sound (ee) is introduced first, followed by the short ^ sound. 
Considerable emphasis is then given to the teaching of initial blends 
in association with these vowels. The remaining short and long vow- 
els are Introduced in a specified sequence, followed by the other 
vowel elements on the chart. 
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The Phonovisual program for the second grade and beyond in- 
cludes the teaching of syllables, compound words, secondary spell- 
ings, "sound” words, and prefixes and suffixes. Instruction in 
these areas is not recommended by the authors of the method unless 
the children have mastered all of the techniques prescribed for the 
first grade. Indeed, second-grade teachers are cautioned to re- 
teach the entire first-grade program when elements of that program 
are not known by the students. 

Comparison Between BR Method and PV Method 

Reference has already been made in the beginning of this chap- 
ter to the common elements which both the BR and PV Methods share. 
These common elements are of sufficient significance as to warrant 
considering both methods as variation of a SC Approach. 

In CRAFT 2, both methods utilized typical instructional pro- 
cedures recommended for use with basal readers . The PV Method dis- 
carded only the phonics and structural analysis phase of instruction, 
including the use of the correlated basal reader workbooks and 
substituted Instead the Phonovisual system of phonics, including 
its workbooks. Since this system is highly structured, and comes 
complete with a manual and instructional aids, there was a distinct 
tendency to emphasize phonics skills in classes using the PV Method 
more than in those using the BR Method. 

Classes using the BR Method used a two, or three group system 
for reading instruction, including the teaching of phonics. Teachers 
using the PV Method, however, tended to utilize grouping only for 
those activities which Involved the use of the basal readers, and 
taught the phonics lesson on a whole class basis. 

Since a relatively large proportion of Instructional time was 
needed in order to cover the Phonovisual program, it was not feasible 
for the teacher to make several presentations, which the grouping 
system would have required. The obvious result of this whole class 
approach to the teaching of phonics in the PV Method was that less 
consideration could be given to individual differences in learning 
ability. 

All children participated in the Phonovisual program at the 
same time. For some, the reinforcement activities may have provided 
too much repetition, while for others, too little. In the BR Method, 
where grouping prevailed, the teacher could modify the rate of intro- 
duction of the phonics program, depending on the level of the basal 
reader used and the learning rate of the group. 

The consonant and vowel charts used in the PV Method were placed 
on the walls of the classroom and constantly exposed to the pupils. 
They provided a readily available guide to the pronunciation of the 



46 



key phonic elements. Pupils could make use of these charts through- 
out the day, for example, during the reading of science and social 
studies texts which frequently took place In the afternoon. The 
pupils In the BR Method did not have exposure throughout the day to 
any similar type of reading aid. 

Lastly, It should be noted that the BR Method, as suggested In 
the teacher's manuals, tends to Introduce word attack skills on a 
relatively gradual basis so that a considerable portion of the pho- 
nics program Is not Introduced until grades two and three. In the 
PV Method, all the phoi^lc elements are usually Introduced In grade 
one; In grade two, previously taught skills are reviewed, and any 
which were not covered In first grade are Introduced. In CRAFT 2 
PV classes, some teachers reviewed both charts on a systematic 
basis, while others emphasized only the vowel chart, referring to 
the consonant chart as needed. 

Language Experience Method 

The LE Method In CRAFT 2 placed considerable emphasis on 
pupil-teacher Interaction In order to stimulate oral communication, 
which In turn served as the basis for the development of experience 
charts. Since basal readers were not used as a vehicle for Instruc- 
tion, It was necessary for the teacher to develop material for use 
during the reading period. Charts were reproduced as booklets In 
large type. 

The Implementation of the LE Method required a great deal of 
teacher Initiative. Themes for the experience charts had to be 
sought quite diligently to maintain the Interest of second-grade 
children. Experiences which provided themes for charts Included 
trips, school assemblies, current events of Interest to children, 
science (weather, animals, plants). Interesting events at home, 
social studies (elections, holidays, famous men), and unusual situa- 
tions which frequently occur In a city as large as New York. 

The teachers using the LE Method In CRAFT 2 experienced as much 
difficulty In Initiating the program as did teachers In the first- 
grade study. The contrast with the basal reader program, which the 
teachers had studied or used, was marked. The LE Method was utilized 
on a whole class or Individual basis; the basal program was usually 
applied with children In .small groups . The LE Method depended on 
oral communication for the development of reading materials; the 
basal program progressed through readers. The LE Method sought to 
Integrate Social Studies and Science with the language arts, all of 
which was taught through the LE procedures; the basal program was 
used primarily to teach reading and related language arts skills. 
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Skills instruction in the LE Method was based on the frequency 
of oral and written use of phonic elements by the children. There 
was no prescribed sequence of skills. In answer to the expressed 
need of the teachers, however, a skills workbook was selected (Basic 
Goals in Spelling, Book I, by Kottmeyer and Ware, second edition. 

St. Louis: Webster Publishing Co.) and was continued into Book II. 
Pages were introduced as the need for phonic elements was felt in 
both reading and writing, which were taught concomitantly. 

The first objective of the method was to stimulate discussion. 
The children’s verbalizjations were written down and used for the 
development of word analysis and comprehension skills. Listening, 
speaking, writing, and reading were taught in an integrated attack 
on the language arts . 

The LE Method in CRAFT 2 placed more emphasis on individualized 
reading than did the program in CRAFT 1, which did, however, start 
to Introduce trade books toward the middle of the year. Typically, 
transition to individualized reading was made by small groups of 
children as they achieved enough proficiency in word analysis to 
read independently. Stories in the first books of a variety of co- 
basal literature series were used for effecting this transition. 

In addition, individualized reading was triggered by a series of 
experience charts on a particular theme of Interest to a group of 
children, who were then led to trade books on this theme. All these 
classes had substantial libraries containing at least 50 separate 
titles as well as duplications, provided by CRAFT. In addition, 
school libraries facilities were used liberally and effectively. 

In summary, it may be said that the LE Method stressed oral 
communication for the development of experience charts. Individ- 
ualized reading was increasingly stressed. A spelling workbook was 
available and was used, but not emphasized. Subject matter from 
Science and Social Studies was also taught through experience charts; 
separate texts in these areas were not used on a whole class basis. 



Language-Experience Audio-Visual Method 

The LE-AV Method was substantially similar to the LE Method in 
orientation, instructional procedure, and use of instructional mate- 
rial. Both methods initiated experience charts through oral discus- 
sion, provided for follow-up readi';»g on an Individualized basis, and 
utilized a workbook on a selective basis for spelling and phonics 
skills . 
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They differed in one essential respect: the LE-AV Method intro- 

d^iced a variety of audio-visual aids to supply vicarious experiences 
that would otherwise not have been available to the class. 

The audio-visual aids available to the teachers in this method 
included the overhead projector, filmstrip projector, tape recorder, 
record player, Polaroid camera, and the Phono-Viewer (an Integrated 
filmstrip and record player, made by General Electric). 

It should be emphasized that not all the LE-AV claasrooms had 
all this equipment for the full year. In fact, a serious limitation 
in the implementation of this method in CRAFT 2 was the failure of 
the Bureau of Audio-Visual Instruction to provide full equipment at 
the beginning of the year and to maintain it in working order through- 
out the year . Furthermore , although plans and budgetary provisions had 
been made to utilize the half-time services of an audio-visual con- 
sultant from the Board of Education of the City of New York, it was 
necessary to make two replacements in this position during the course 
of the year, and for several months no A-V consultant was available 
at all. 

The audio-visual aids were used to: (1) provide vicarious ex* 

perlences (records, filmstrips); (2) teach various skills (overhead 
projector), and (3) encourage oral communication (tape recorder). 

Only minimum use was made of the Polaroid camera and the Phono-Viewer 
in CRAFT 2, the former because of difficulty in obtaining film when 
needed, the latter because of frequent malfunctions in the Instrument. 
Another reason for the relatively infrequent use of the camera was the 
disinclination of the second-grade teachers to take field trips, where 
it was most likely to be used. 

The most popular audio-visual Instrument was the overhead pro- 
jector. It was used to write experience stories, teach selected pho- 
nics and spelling skills, and encourage pupil writing. Through the 
use of this Instrument the teacher was readily able to focus the atten- 
tion of the class on the instructional activity. Tills Instrument can 
effectively replace the chalkboard for many activities. 

The filmstrip projector was perhaps the next most popular instru- 
ment. Filmstrips by Weston Wood, Eye Gate, and the Society for Visual 
Instruction were available. Some of the filmstrips came with phono- 
graph records and provided an Integrated audio-visual experience for 
the pupils . 

The phonograph was placed in a listening comer, and through the 
use of an earphone connecting box as many as six children could listen 
to a record at the same time without disturbing the rest of the class. 
The use of the record player tended to encourage grouping procedures 
for instruction. For example, if the teacher was reviewing a particu- 
lar reading skill, those who did not need this review could listen to 
a record. 



49 



The tape recorder was generally used by one pupil at a time or 
by small groups. The Instrument was used by the pupils for record- 
ing an experience or a story, listening to a prerecorded story, and 
developing oral-aural ability. Listening to one's own recording was 
used by some teachers as an effective method of improving clarity 
and correctness of speech. 

Concluding Comments 

The basic distinctions between the two approaches (SC and LE) 
and the two methods in each approach (BR and PV; LE and LE-AV) may 
now be summarized. 

The two approaches differed to the extent to which skills pro- 
gramming, vocabulary control, and story content were employed. The 
SC Approach followed a program based on a structured sequence of 
skills, a vocabulary controlled on the basis of high service words, 
and the story content developed by the authors of basal readers. 

In the LE Approach skills were taught functionally rather than 
systematically, vocabulary control was minimized, and story content 
was selected by the children. 

The distinction between methods was less critical than that be- 
tween approaches, but was nevertheless clearly identifiable. The 
BR Method provided a phonics program which was Introduced gradually 
during the first and second grades. Also, instruction was generally 
offered on a group basis. The PV Method Introduced the significant 
phonic elements during the first year and reviewed them in the sec- 
ond grade. A considerable portion of the time spent In reading In- 
struction In the PV Method was devoted to teaching phonics on a 
whole-class basis. 

The LE Method stressed oral communication which culminated In 
the development of experience charts and booklets. The LE-AV Method 
utilized the same techniques, but utilized various audio-visual aids 
to supplement the usual language experience procedures. 

It should be noted that the SC teachers were encouraged to fol- 
low the New York City curriculum In teaching other aspects of the 
Language Arts, Social Studies, and Science. As has been explained 
In Chapter II, they were asked to spend three-fifths or 180 minutes 
of the school day on reading and supportive activities, allocated as 
follows : 



Erratum. The time allotments given at the bottom of the page are 
incorrect. The correct allotments are shoim on page 40. 
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Other language arts included show-and-tell and other discus- 
sion activities, penmanship, spelling, and composition. Science and 
Social Studies in second grade are generally taught in New York City 
public schools in an informal way centered around activities and 
projects, with outcomes summarized in experience charts. Textbooks 
are not used systematically in these subjects, but are employed as 
references on specific topics. 

There was, then, greater similarity between the SC and LE Ap- 
proaches in supportive activities than in reading activities. How- 
ever, the LE teachers tended to place more emphasis on supportive 
activities, and to spend more time on them. 



2 , Teacher Training Program 

To insure maximum adherence to the particular method assigned 
to each teacher, CEAFT 2 utilized preservice and Inservlce workshop 
sessions, supervision by district reading consultants, and overall 
supervision by the assistant director. 

Preservice and Inservice Workshops 

A first meeting of the CRAFT 2 teachers was held on June 15, 
1965. Prior to the opening of school in September, all CRAFT 2 , 
teachers met at a central location in Manhattan for the first work- 
shop session of the academic year. This workshop was held from 
9:00 a.m. to 3:00 p.m. on September 9, 1965. A subsequent central 
workshop session was held on January 17, 1966, from 4:00 p.m. to 
5:30 p.m. In addition to these central meetings, monthly district 
meetings were held throughout the year. 

Four reading consultants, an early childhood consultant, and 
theoretically an audio-visual consultant, all of \diom held full- 
time positions with the Board of Education of the City of New York, 
spent a substantial portion of their time in CRAFT 2. Each of the 
reading consultants was designated as a specialist and workshop 
leader for a particular CRAFT method. It was the consultant's re- 
sponsibility to become thoroughly familiar with the teaching pro- 
cedures of the method for \dilch she was responsible, and prepare 
instructional bulletins for dissemination at the central workshop 
meetings. The consultants served as leaders when the workshop 
meetings divided into four sub-groups , one for each of ‘ the CRAFT 
methods. Part of each central meeting was used for explanation 
of the project as a whole and of specific procedures conmoii to all' 
methods, such as the Teacher Logs and the testing program. Part 
was spent in separate meetings for the four teaching methods, so 
that all teachers in the same method could share problems and sol- 
utions . 

District meetings were held monthly, and these were organized 
and led by the reading consultants. Often the monthly workshop 
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sessions for specific methods were held on different days so that 
teachers of a particular method could come together to share common 
experiences and receive additional guidance In the application of 
the appropriate teaching techniques. 

Supervision by District Cbnsultants 

The four reading consultants, the audio— visual consultant (when 
available) and an early childhood consultant met monthly with the 
project director and assistant director In order to coordinate the 
training programs and the supervision of the CRAFT teachers. These 
meetings tended to last several hours. 

Each of the consultants developed and distributed Instructional 
bulletins. All the consultants had sufficient familiarity with each 
of the four methods to be able to assume supervisory responsibility 
with the CRAFT teachers In her district. In effect, each consultant 
became a specialist In a single method and (well-versed) In all four 
methods. This made It possible for each consultant to concentrate 
on schools in a particular district, and provide assistance for all 
CRAFT teachers in these schools, which Included all four methods. 

The reading consultant visited the CRAFT 2 classes in her dis- 
trict several times a month; the audio-visual consultant was to visit 
only the cl.asses using the A-V method. Discussions of these visi- 
tations were held at the monthly meetings of consultants with the 
project director and assistant director, and provided a continuing 
source of feedback on the progress of the study. 

Supervision by the Assistant Director 

The assistant director was able to make periodic visits to each 
of the CRAFT 2 teachers. This usually involved spending a full day 
at each of the 11 CRAFT 2 schools. The assistant director would ob- 
serve the teachers in the morning, and usually meet with them for 
lunch. Occasionally, the principals of the school and the district 
reading consultant also joined the luncheon meeting. Frank discus- 
sions were held on the problems and successes which the teachers had 
encountered. 

The observations made by the assistant director were presented 
and discussed at the monthly consultant’s meetings. These discus- 
sions served to unify the Instructional procedures applied to each 
of the methods throughout the CRAFT 2 schools. This was an impor- 
tant consideration, since the assistant director alone was in a posi- 
tion to visit all the CRAFT 2 classes. 

3. The Role of the School Principal 

Without the active support of the principals the project could 
not have succeeded. The principals and their assistant principals 
helped in a variety of ways. 
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1. The principals moved the first-grade CRAFT classes into the 
second grade with the least possible alterations. Classes 
were maintained as nearly intact as possible. When new 
second-grade children registered, they were assigned to 
CRAFT and non-CRAFT classes on a random basis. 

2. The principals set up and maintained a record-keeping system 
for transfers so that pupils who left the CRAFT classes 
could be traced later to their new schools. 

3. The principals were responsible for the distribution to 
CRAFT teachers of many shipments of A-V equipment, supplies, 
and reading materials. 

4. The principals gave active support to the CRAFT project in 
their discussions with the CRAFT teachers and other teach- 
ers, thus contributing immeasureably to the maintenance of 
morale among the CRAFT teachers. 

5. The principals took the initiative to report to the central 
research staff any problems that arose in the operation of 
the project in their schools. In this way numerous minor 
emergencies were effectively and promptly handled. 

6. The principals volunteered to plan the details of the test- 
ing schedules in their schools, and temporarily relieved the 
Corrective Reading teachers of other duties so that they 
could administer the group posttests in the CRAFT classes. 

7. The principals accepted and respected the use of hetero- 
geneous grouping in CRAFT classes, although most of the 
other classes in their schools were grouped on a relatively 
homogeneous basis. 

8. The principals received and read voluminous nflmeographed 
communications from the CRAFT central staff. These Included 
minutes of the central meetings and copies of all materials 
sent to the CRAFT teachers. 

9. Many principals had to exercise ingenuity in order to sup- 
ply all the materials required by the nature of the project. 
In some schools, for example, basal reader workbooks were 
not customarily used and had to be obtained out of special 
funds . 

10. Special meetings were held at the Board of Education for the 
principals and the assistant superintendents in charge of 
the CRAFT schools. Attendance at these meetings was very 
good, despite very busy schedules. One Important function 
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of these meetings was to clarify and correct misunder- 
standings that arose about the project, and to Indicate 
clearly what the research budget could provide and what 
would have to be supplied by the schools. Another func- 
tion was to provide for the airing of grievances. A 
third was to provide group thinking of experienced admin- 
istrators on the solution of operational problems that 
cropped up from time to time. A fourth was to Inform the 
principals about results and to give them an opportunity 
to discuss the published project reports. 
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CHAPTER V 



SECOND GRADE CONTINUATION RESULTS 



1. CRAFT and Non-CRAFT Children 

As mentioned In Chapter III, 656 CRAFT 1 children In 38 classes 
participated In the testing program at the conclusion of the second 
grade. These figures Indicate that an average of 17 children who 
participated In CRAFT 1 remained In CRAFT classes through the con- 
tinuing year. Because class enrollment averaged 26 students, the 
remaining pupils entering CRAFT classes after the study began were 
designated as non-CRAFT pupils. The presence of CRAFT and non-CRAFT 
students In the same classes raises the question of whether the latter 
group had a differential effect on the Instructional results. 

Unfortunately a comparison of the learning potential of the two 
groups was Impossible to make , since New York public school regula- 
tions forbid the administration of mental ability tests, and readi- 
ness scores were not available for the non-CRAFT pupils. However^ as 
reported In Chapter III, CRAFT 2 students did not d*^.ffer substantially 
from CRAFT 1 children when compared on the basis of their respective 
first grade pretest and posttest scores. And, since observable char- 
acteristics of children transferring Into CRAFT schools did not 
appear to be different from those of children who had left the study. 
It was also hypothesized that non-CRAFT students did. not differ In 
learning ability from those CRAFT children whom they replaced. This 
supposition appears to be justified when a comparison of the two 
groups of students Is made. 

The differences In unadjusted mean scores for children parti- . 
clpatlng In each of the four methods are presented In Table 5.1. 

This table Indicates that although CRAFT 2 pupils had higher mean 
scores than non-CRAFT pupils on all sub tests of the Metropolitan 
Achievement Tests, In only four of the 20 comparisons were the dif- 
ferences significant. All four of these significant differences 
favored CRAFT children In the Fhonovlsual classes. Nhy this differ- 
ence exists Is not exactly known. The most probable explanation Is 
that non-CRAFT children In the FV Method may have done less well than 
their CRAFT counterparts because significantly fewer of them trans- 
ferred Into CRAFT classes than In any other method, and adequate In- 
structional adjustments may not have been made to Insure that enter- 
ing students were given the equivalent of first-year training In the 
Fhonovlsual method. 

When the raw scores are converted Into grade equivalent scores 
(Table 5.2) It can be seen that, as expected, CRAFT students In Fhono- 
vlsual classes had a greater advantage over their non-CRAFT class- 
mates than did CRAFT children taught by other methods. The difference 
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favoring CRAFT students in the Phonovisual method was five months on 
the Word Discrimination test, four months on the Word Knowledge and 
Spelling test, and three months on the Reading test. 

CRAFT students in classes taught by the other three methods also 
had higher grade equivalent scores than did non-CRAFT children on all 
sub tests except one Cwhere both groups of children taught by the 
LE-AV Method obtained the same Score — 2.2 ~ on the reading subtest) 
The difference in grade equivalent scores between the two groups aver- 
ages out to .35 on the Word Discrimination test, .25 on Word Knowl- 
edge, .28 on Spelling, and .15 on Reading, Although the differences 
favoring the CRAFT pupils in the three methods are not individually 
significant, the consistency of the trend is notable. 

The grade equivalent means for the MAT Arithmetic test are also 
reported in Table 5.1, and reveal that children taught by the four 
methods, as well as children separated into CRAFT and non-CRAFT cate- 
gories, achieved at approximately the same level. This finding would 
appear to Indicate that the teaching of arithmetic was not only con- 
sistent within the four sets of classes but also for CRAFT and non- 
CRAFT students. This minimizes the possibility that the teaching of 
arithmetic for any one group of students had a differential effect on 
reading achievement scores, or that arithmetic was differentially 
slighted in any CRAFT method. 

With regard to differentiating effects it should also be noted 
that children identified as "early readers" in the study, children 
idio had kindergarten experience, and the numbers of boys and girls, 
were about equally divided in the approaches by which they were 
taught, thereby minimizing the possibility that these factors may 
have influenced the achievement results in a particular approach. 
Analyses of the achievement made by these sub-groups are included 
in a later section of this chapter. 

2. Results for the Total CRAFT 2 Population 



The second grade classes were all given the five subtests of 
the Metropolitan Primary II Battery, Form C, (MAT) during the third 
week of April, 1966, as described in Chapter III. 

Unadjusted Results 

The raw score means for the SC and LE Approaches are shown in 
Table 5.3. The SC means were slightly higher on all sub tests than 
the means for classes taught by the LE Approach. The differences in 
mean raw scores did not exceed 2.22, this being the disparity on the 
Spelling sub test, and averaged only 1.69 on the three Reading sub- 
tests. None of these differences was statistically significant. 

When the mean scores are converted into grade equivalent scores the 
absence of significant differences between the approaches becomes 
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more apparent. (Table 5.4). When New York City norms are used for 
comparison purposes on the three reading subtests, there Is no grade 
equivalent difference on Reading, one month on Word Knowledge, and 
two months on Word Discrimination. Identical differential results 
are obtained when national norms are used. A comparison of the two 
sets of norms Indicates very minimal differences between them, and 
at no time Is the discrepancy greater than one month. 

Since the unadjusted scores favored the SC Approach classes on 
all subtests. It Is not surprising that when methods are comparedi 
(Table 5.3), children In the BR and PV Methods ranked either first 
or second on each of the Reading subtests and On Spelling. The BR 
Method had slightly higher scores on Word Knowledge and Spelling 
and the PV Method on Word Discrimination and Reading. The LE~AV 
Method scored lowest on all three reading sub tests, but slightly 
higher than the LE Method on Spelling. There was no significant 
difference bn any of these comparisons according to jt tests. 

When the unadjusted mean raw scores for methods are converted 
Into jgrade equivalents, there Is little In the way of difference^ 
between methods. The greatest difference between any of the meth- 
ods Is two months, and the range of grade equivalent scores extend ' 
from . 2.2 and 2.6. This Is somevdiat below the norm of 2.7 for 

April testing. 

A breakdown of unadjusted scores was also made by classes 
within methods In an effort to determine the extent of differences 
among classes utilizing the same method. Using the MAT reading 
subtest as an example, wide variations can be noted, especially In 
the BR Method where the range In class means was two years , three 
months (Fig. 2). These differences were dramatic, considering the 
random assignment of children to classes. The wide range for the 
BR classes is attributable mainly to the superior scores attained 
by children In one class , whose mean grade equivalent on the three 
Reading sub tests averaged 3.8 on New York City norms. Reasons for 
the superiority of this class are not precisely known. 

Although the differences for the classes using the other three 
methods were not' as great as for BR, neither were they minimal. When 
scores for the three Reading sub tests are averaged, the grade equiva- 
lent range Is eight months for PV, one year for LE, and seven months 
for LE-AV. Thus the range In class means within each of the methods 
Is far greater than the difference between any two methods. 

Adjusted Means 

As described In Chapter III, raw score means were adjusted by 
both first-grade pretests and first-grade posttests. Adjusted 
scores In the former Instance were used to equalize differences In 
learning potential evidenced by the CRAFT pupils early In the first 
grade, and In the latter Instance to offset Instructional advantages 
obtained during the first year of the study. The intercorrelation 
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matrix for pretests and posttests Is shown In Table 5.5. The mul- 
tiple regression equations are shown In Tables 5.6 and 5.7. 

The Intercorrelatlons of the pretests, the first-grade post- 
test scores, and the second grade MAT posttest scores, are shoim 
In Table 5.5. With the exception of some of the re's Involving kin- 
dergarten experience, all of the ^'s In this table are significant 
at the .01 level. It was decided to use kindergarten experience 
and the four pretests (Variables 1-5) as predictor variables In mul- 
tiple regression equations. The resulting equations are shown In 
Table 5.6. From the predicted scores, adjusted class means and ad- 
justed means for approaches and methods were obtained, as described 
In Chapter III. 

When the means were adjusted by either pretests or posttests 
the outcomes were not substantially different from results reported 
for the unadjusted scores (Tables 5.8 and 5.9). When adjusted mean 
scores by approaches were compared, the SC classes achieved at a 
higher level than the LE classes on all four sub tests.* The mean 
differences between the two approaches were somewhat greater for ad- 
justed scores than when a similar comparison was made for unadjusted 
scores, but do not reach statistical significance. 

When means adjusted by pretests were compared by method, BR and 
PV means were higher than the means, for the LE and LE-AV Methods on 
all subtests, with the BR Method highest on Word Knowledge and Spell- 
ing, and the PV Method best on Word Discrimination and Reading. Con- 
versely, LE classes did least well on subtests where the Basal Method 
Is superior, and the LE-AV classes did least well on sub tests where 
the achievement scores for the Phonovlsual classes were highest. One 
of these latter differences, favoring PV over LE-AV on Word Discrimi- 
nation, Is significant at the .05 level (Table 5.12). The other Inter 
method differences are not significant. 

Comparison of means for methods adjusted oh the basis of first- 
grade posttests reveals slightly smaller differences than when means 
adjusted by pretests were compared. Despite this diminution In dif- 
ferences, there Is still a significant difference between PV and LE-AV 
favoring the former at the .05 level of significance, on Word Discrim- 
ination. 

Grade equivalent scores also reveal the relative superiority for 
the SC Approach and Its component methods. Comparing Approaches on' 
the pretest adjustment (Table 5.10), there Is a four month difference 
favoring the SC Approach over the LE Approach on Word Discrimination, 
two months on both Word Knowledge and Reading, and three months on 
Spelling* Similar differences are found on the basis of posttest ad- 
justments (see Table 5.11)/ 



^Arithmetic scores were not adjusted 
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The range of grade equivalent scores based on raw scores and 
adjusted scores are shown in Tables 5.13 and 5.14. 

The differences among the class means adjusted by pretests were 
far greater within each of the four methods than any of the differ- 
ences between methods. The greatest range was In the BR Method, and 
was again due to extremely high adjusted means for one class, which' 
not only had the highest unadjusted means but also benefited from 
the adjustment. Similar large differences within methods were found 
when the means were adjusted by first-grade posttests. Whiie the 
general result of the posttest adjustments (Table 5.15) was to lower 
the means for the method that had done best in first grade (BR) and 
to raise somewhat the means for the method with the poorest first- . 
grade results (LE), the range of class means within each method re- 
mained large and far exceeded differences between the means for 
methods. 

Using the MAT Reading subtest, the spread of class means is 
shown in Figure 2, for unadjusted means and for both adjustments. 

Here it can be noted that a variation of from one year to several 
years exists when the means of the highest and lowest achieving . 
classes are compared. Because of these variations within methods, 
only two of the ^ tests between methods showed significance, and in 
each comparison PV was significantly higher than LE-AV in Word Dis^ 
crimination (Table 5.12). 

Analysis of Variance for the MAT Subtests 

For CRAFT 2 the analyses of variance were conducted in a series 
of steps for each of the posttests. The steps may be illustrated by 
considering the analyses for the MAT Word Discrimination subtest, on 
which differences between approaches and methods were slightly larger 
than on the other MAT subtests. 

First a one-way analysis was done testing variance between ap- 
proaches against variance within approaches; the resulting F ratio 
was not significant (Table 5.16). Secondly, variance between schools 
and between approaches within schools was tested against variance 
within approaches and schools , keeping the two schools which had had 
split-session schedules in the first grade separate from the nine 
schools with full-session first-grade schedules; again the differ- 
ences were not significant (Table $.17). Each SC method was then com- 
pared with each LE method, keeping the split-session schools separate, 
again with no significant differences (Table 5.18). Because split 
session had made a significant difference in the first-grade results, 
the differences between approaches, between schools, and between 
methods were computed again, this time leaving out the split-session 
schools; again no significant differences were found (Tables 5.19, 

5.20 and 5,21). 

Similar analyses, carried out for the MAT Word Knowledge, Reading, 
and Spelling subtests adjusted for pretests, failed to reveal a 
single significant difference between approaches or between methods. 
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The same methods of analysis were carried out also for the 
subtests adjusted on the basis of the first-grade posttests. 

Again, not a single difference between approaches, between schools, 
or between methods was large enough to be significant at the .05 
level; In all of these analyses the differences between approaches 
and methods were reduced to Insignificance by the much larger dif- 
ferences within approaches and methods.* 

Results for Reading Interest Measures 

Apart from the results achieved by the experimental population 
on the MAT, efforts were also made to assess the amount of reading 
done by the CRAFT 2 children, and to determine the degree of their 
eagerness to read and the maturity of their reading choices. 

Thesh findings are summarized In Table 5.22. They reveal a 
somewhat uneven pattern Inasmuch as LE classes completed more books 
and Indicated slightly more eagerness to read than other classes, PV 
classes read more books on a partial basis, and BR classes had a ten- 
dency to select more mature books. When differences between ap- 
proaches and methods are compared, however, they are small enough to 
preclude any statistical significance except In one Instance which 
favors LE-AV over PV In the number of books completed; the LE-AV 
mean of 4.01 compared to the PV mean of 2; 23 Is significantly dif- 
ferent at the .05 level. 

The absence of additional significance can be explained by the 
relatively large S.D.'s, Indicating that wide discrepancies existed 
In the class means within approaches and methods. For example, the 
LE classes read more books than classes taught by other methods. Yet 
the S.D. of the LE group (6.34) was almost equal to the mean (6.60) 
and there were no significant differences between the LE classes and 
other classes. 

t 

All of the means In Table 5.22 related to the children’s eager- 
ness to read, as rated by teachers, fall within the range of 2.93 to 
3.44. Since a score of 3.0 Indicates that children are eager to read 
"about half of the time" It would appear that none of the means for 
either approaches or methods vary considerably from that estimate. 

The mean difference favoring the LE Approach Is minimal, and the dif- 
ference between the highest method (LE-AV) and the lowest (PV) Is not 
significant. 

Means for teachers* estimate of children’s maturity of reading 
choice also cluster around 3.0, Indicating that the selection of books 
made by classes as a whole approximates their reading level In the 



*The 36 analysis of variance tables for Word Knowledge, Reading, 
and Spelling, adjusted by pretests and posttests, are available In the * 
project files. 
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opinions of the teachers. In other words, the children did not tend 
to choose books that were too easy or too difficult for them. Dif- 
ferences between approaches are negligible, as are differences be- 
tween methods. 

In summary, it can be said that neither approach improved chil- 
dren's eagerness to read or their maturity of reading material more 
than the other. Although children in the LE Approach had a tendency 
to read more books (than children in the SC Approach) the difference 
between the approaches is not significant, precluded perhaps by the 
wide differences that existed among classes taught by the same ap- 
proach. 

San Diego Pupil Inventory . The questionnaire. An Inventory of Reading 
Attitude (Standardization Edition) developed by the San Diego County 
Schools, was administered to all pupils as a posttest in CRAFT 1 and 2. 
CRAFT 2 results are shown in Table 5.23. Means ranged from 18.35 (BR) 
to 19.09 (LE) , a very small difference which is not statistically sig- 
nificant. In CRAFT 1 the means had ranged from 14.98 (PV) to 17.20 
/(BR) , with a significant difference of over two points between the two 
SC methods. There was, then, a general upward change in attitude to- 
ward reading as measured by this instrument, with the largest gain 
(over three points) in PV and the smallest gain (one point) in BR. The 
mean for all combined methods rose from 15.91 in CRAFT 1 to 18.83 lii 
CRAFT 2. 



3. The Subsample Results 

As in CRAFT 1, individual reading tests were given to a sample 
group of four children chosen at random from each class. This group 
consisted of 152 children, 40 of whom were in BR, 40 in PV, 36 in LE, 
and 36 in LE-AV classes. 

In an effort to determine the representativeness of the subsample 
group in relation to the total CRAFT 2 population, t tests were made 
using the MAT second-grade posttests as the measuring variable (Table 
5.24). An examination of scores made by both groups reveals that the 
subsample children had slightly higher scores on all of. the subtests, 
but ndiie of these differences was significant. A similar condition 
prevails when the subsample children are divided into methods and 
their scores on the MAT are compared with those of all CRAFT 2 chil- 
dren in the same method. The subsamples in the LE, PV, and LE-AV 
classes did consistently better than the total population, but none 
of the ^ values is high enough to be significant. However, subsample 
children in the BR group did less well than their classmates, although 
here again the differences are not statistically significant. The 
tables for these four sets of comparisons, none of which revealed a 
significant difference, are not presented here but are in the project 
files. It would appear ahat the subsample constitutes a representa- 
tive sample of the total CRAFT 2 population. 
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In all, nine measures were obtained for the subsample children. 
Four of these — Accuracy and Rate Scores for the Gilmore Oral Read- 
ing Test, the Gates Graded Word Fronounclatlon Test, and The Fry List 
of Phonetically Regular Words 7 - were concerned with components of 
oral reading and word recognition. The remaining five measures were 
obtained from a Writing Sample and were scored on the basis of the 
Number of Running Words; Different Words; Correctly Spelled Words; 
Polysyllabic Words; and Mechanics Ratio (the grammatical correctness 
of the writing) . 

In CRAFT 1 the obtained scores were adjusted on the basis of 
first-grade pretests for only three of the nine Individual measures; 
the covariance adjustment could not be carried out on the other six. 
measures because of occasional empty data cells on the pretests. For 
this reason. It seemed Important to adjust the CRAFT 2 Individual 
posttests on the basis of the first-grade pretests, thus getting an 
adjusted measure of total progress during two years of Instruction. 

In analyzing test results two statistical treatments were used, 
^ tests and analysis of variance. In making the Jt test comparisons 
the means scores of children rhther than classes were used, and these 
were adjusted on the basis of pretests since It was found that sig- 
nificant £*s existed between the pretest measures and the tests ad- 
ministered to the subsample group (see Table 5.25). 

The means and standard deviations for the Individual tests are 
shown In Table 5.26 - 5.28. Table 5.26 gives the obtained results 
for the four methods; Table 5.27 gives the results for the adjusted 
scores, using the child as unit; and Table 5.28 gives the adjusted 
results using the class means as units. It may be noted that the 
means are almost exactly the same In Tables 5.27 and 5.28, since 
there were four subsample children In each class; slight differences 
are due to rounding errors. The standard deviations, however, are 
substantially larger In 5.28 than In 5.27, showing that the varia- 
bility among class means was quite consistently larger than the vari- 
ability among Individual pupils. 

Table 5.27 reveals an uneven pattern. As might be expected, 
children In the PV method had the highest scores on the Fry test. 
Since this test consists of 45 Items, the PV mean of 22 Indicates 
that these children could correctly Identify approximately 50 per 
cent of the test Items. This Is 25 per cent better than children In 
the BR and LE-AV classes and 33 per cent better than children In the 
LE classes . 

On the other hand. It might not have been expected that the PV 
children would also do better than their subsample peers on the Gates 
Graded Word Pronounclatlon Test, since the test Items here Include 
many high service words that are phonlcally Irregular. However, PV 
children as a group correctly Identified 52 per cent of the Gates 
test Items. This compares with 42 per cent for the BR and LE-AV 
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groups and 37 per cent for the LE group. Thus it appears that train- 
ing in a highly phonic program had a favorable effect on word recogni- 
tion. 



Children in the PV classes also had the highest scores on Gilmore 
Accuracy, achieving an adjusted grade equivalent mean of 4.0. This 
is six months better than the BR group, eight months better than the 
LE-AV children and 1.1 years higher than children in the LE classes. 
The latter group, which had the lowest scores on Gilmore Accuracy, had 
the highest scores on the Gilmore Rate Score, indicating at least in 
this case that speed of reading does not necessarily correspond with 
reading accuracy. It is noteworthy that the means for all four meth- 
ods were above the norm on Gilmore Accuracy. 

To check the expectation that differences would test as signifi- 
cant when based on individual pupil scores but would test as less 
significant or non-slgnlf leant when based on class means, ^ tests were 
computed on the basis of means of individual scores, while analyses of 
variance were based on class means . 

f • 

When Jt scores were computed comparing subsample groups In the 
four methods with one another on the four oral reading measures, the 
PV children were significantly higher than BR and LE-AV groups on all 
tests at the .01 level, aiid similarly higher than the LE children on 
all but Rate (Table 5.30). In turn the BR children did significantly 
better than the LE group at the .01 level on all tests except Rate, 
and better, but not significantly so, than LE-AV on three tests; on 
the Fry test LE-AV had a fractionally higher score. Comparisons be- 
tween LE and LE-AV reveal significantly higher scores for the latter 
on Gilmore Accuracy and Fry at the .01 level, and significantly lower 
scores for the same group on Gilmore Rate. 

Analysis of Variance for Oral Reading Tests 

For the oral reading tests given to the subsample, the analysis 
of variance was carried out only for the means adjusted by first-grade 
post tests, to give maximum weighting to learning in the second grade. 
Although, as has been shown above, some of the mean differences be- 
tween approaches and methods looked substantial, the variance within 
each approach and method was so great that none of the differences be- 
tween means reached the .05 level of significance. This was true of 
the Gilmore Accuracy and Rate scores, the Gates Graded Word Pronuncia- 
tion Test, and the Fry Test of Phonetically Regular Words. These 
analyses are available in the Project files. As examples, the analy- 
ses for the Fry test are given in Tables 5.31, 5.32, and 5.33. 

Writing Sample Results 

Children in PV did less well than children in other methods on 
four of the five Writing Sample scores (Table 5.30). Children in 
LE-AV had highest means on Polysyllabic words and Mechanics Ratio, and 
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second highest means on the three remaining scores. The BR group 
did better than children In the other three methods on the Number 
of different Words and the Number of Running Words Spelled Correctly. 

Comparisons between method groups by ^ tests reveal significant 
differences at the .01 level favoring BR children when compared with 
PV children on all writing scores, and similarly significant advan- 
tages for BR children over LE children on all but the Mechanics Ratio 
score, where the reverse Is true. BR children also did significantly 
better at the .01 level than LE-AV children on three of the five 
scores, but significantly poorer than the latter group on Polysyllabic 
Words and Mechanics E^tlo, also at the .01 level. There were no sig- 
nificant differences between LE and PV children except on Mechanics 
:Jlatlo (where the LE group held a distinct advantage) but the LE-AV 
children did significantly better than the PV group on all writing 
sample measures. Similarly the LE-AV children did better than the 
LE children on five tests, four of which were significant at .01. 

On the basis of these results It would appear that the kind of 
Instruction received by the PV group resulted In superior performance 
on oral reading and word recognition tests, but that there was appar- 
ently no carry over to the tests measured by the Writing Sample. The 
BR group did less well on the oral reading tests than the PV children 
but better than either the LE or LE-AV group. They also were ahead 
of the LE and LE-AV groups In most of the measures obtained from the 
Writing Sample. The LE-AV children did well on the Writing Sample 
measures, but the same cannot be said for the LE children. Why dif- 
ferences should favor the LE-AV group on this aspect of the testing 
.program Is not known. 

Analysis of Variance for the Writing Sample 

Analyses of variance were performed for the five scores based on 
the Writing Sample, using class means adjusted by first-grade pre- 
tests. For four of the scores (Number of Running Words, Number of Dlf 
ferent Words, Number of Words Spelled Correctly, and Mechanics Ratio) 
the differences between approaches and between methods were consis- 
tently below the .05 level of significance. For the fifth score. Num- 
ber of Polysyllabic Words, two significant differences between methods 
were fotind: PV was significantly above LE-AV In the split-session 

schools, at the .05 level, and LE-AV was significantly higher than BR 
at the .01 level. The SC Approach surpassed the LE Approach In both 
split-session and full-session schools, with both differences signi- 
ficant at the .05 level. The difference between approaches seems to 
be due mainly to the poor performance of the LE-AV classes on this 
measure. The analyses for Polysyllabic Words are shown In Tables 
5.34, 5.35, and 5.36. No good reason has occurred to the Project 
staff to explain why there were significant differences on Polysyl- 
labic Words, when all of the other group and Individual measures of 
reading and writing failed to show significant differences. 
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4. Comparison of Bovs and Girls 



In many studies of beginning reading, girls have repeatedly been 
reported as surpassing boys in their own school populations, both in 
readiness and in reading achievement. In the CRAIT project this did 
not happen when comparisons were made on the readiness pretests and 
on first-grade reading posttests. However, second-grade posttests 
indicate a slight superiority of girls over boys when comparisons are 
made using mean raw scores and means adjusted by first-grade posttests. 

The data on sex differences at the end of the second grade are 
summarized in Table 3 5.37 and 5.38. In Table 5.37, where obtained 
means are given, it can be noted that girls had sli^tly higher means 
on 17 of the 20 comparisons related to reading and spelling and that 
four of the differences are significant at the .05 level; three in 
Spelling and one in Word Discrimination. 

Despite the fact that the boys did not have significantly higher 
scores than girls on any of the comparisons, they did have consistently 
higher scores than girls on the three Reading sub tests in the LE-AV 
classes. This finding suggests the possible influence of machines as. 
a motivating factor for the male population in these classes. 

Table 5.38 shows the comparisons between boys and girls when, the 
second-grade post tests are adjusted by first-grade post tests.* Here 
again girls had higher scores than boys on all of the MAT subtests • 
and in all of the classes except LE-AV, where the boys had a slight 
advantage on Word Knowledge and Reading. As in the raw score compari- 
sons, the differences of greatest significance favoring girls were in 
Spelling. Otherwise girls scored significantly better than boys in 
the PV classes on Word Knowledge and Word Discrimination, and in the 
mean for the combined methods oh all. three Reading subtests. 

Results of the comparisons between girls and boys would seem to 
indicate that the differential favoring girls can be attributed to 
characteristics within the content and process of the curriculum, 
since readiness tests revealed no initial differences between the 
sexes. In addition, it appears that boys profited from instruction 
which emphasizes the use of mechanical devices to a very slightly 
greater extent than girls did. 

It should be noted that these results have been based on the 
child as the statist '.cal unit. If the class had^.been used as the unit 
many of the presently significant differences would have appeared non- 
significant. However, the consistency of the trends favoring the 
girls in the second grade would not be affected. 



*Itt‘ computing t values the S«D«*s of the obtained scores were 
used since S.D.’s for adjusted means were not available. 
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5. Comparison of Kindergarten and Non-Kindergarten Children 



Two-thirds of the second-grade pupils had attended kindergarten 
for 101-200 half days, while 27 per cent had no pre-first grade 
schooling. The proportion with 21 to 100 half days was very small, 
and those with preschool experience in addition to kindergarten was 
still smaller (Table 5.39). Accordingly, the latter two groups are 
not considered In this analysis. 

Pretest Results 



A detailed analysis of pretest results was made by Serwer (1966) 

In a doctoral dissertation, using 147 of the CRAFT 1 pupils attending 
two Harlem schools. None of the differences between the means for 
boys and those for girls was statistically significant. Kindergarten 
and non-kindergarten children were compared. The kindergarten chil- 
dren had higher means on six sub tests; on three (Metropolitan Listen- 
ing, Murphy-Durrell Letter Names, and Thurstone Identical Forms) the 
differences were not significant. On two tests (Murphy-Durrell 
Phonemes and Learning Rate) the difference was significant at the 
.05 level, and on one test (an experimental visual-motor test) the 
difference was significant at the .01 level. She concluded that for 
her pupils, kindergarten experience was accompanied by significant 
growth in visual-motor coordination and auditory discrimination, but 
not in comprehension of oral language, in knowledge of letter names, 
or in visual discrimination of geometric designs. She concluded that 
the kindergarten program in the two schools should Incorporate teach- 
ing of letter names and more stress on visual discrimination and on . 
comprehension of oral language. 

Since the population used by Serwer was quite representative 
of the total CRAFT 1 population, it was not felt necessary to repli- 
cate her study with the remaining CRAFl' 1 children. 

Achievement Js. First Grade 

Thirty-five comparisons were made between children with and without 
kindergarten experience, for the total population and for approaches and 
methods (Table 5.40). The sub tests of the Stanford Achievement Test 
(Primary 1 , Form X) served as measuring variables. All 35 comparisons 
favored kindergarten children and 24 of these were significant, 20 at 
the .01 level, and four at .05. When the scores were converted into 
grade equivalents, the differences between the two groups dd not indi- 
cate any vast differences (Table 5.41). The kindergarten children 
achieved at the 1.5 level on four of the five subtests and at 1.6 on the 
fifth (Spelling), while the non-kindergarten group scored at the 1.4 
level on four subtests and at the 1.5 level on Spelling. Thus, despite 
the significant differences in raw score means, the average grade equi- 
valent difference between the two groups near the end of CRAFT 1 was 
only about one mpnth. 
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When the two groups are compared within approaches, the LE kinder- 
garten children had significantly higher means on all five sub tests at 
the .01 level, and kindergarten children In the SC classes did signifi- 
cantly better at the .01 level on Paragraph Meaning and Vocabulary and 
at .05 on Word Reading (Table 5.40). Grade equivalent means for ap- 
proach comparisons (Table 5.41) reveal a slight advantage for kinder- 
garten children In both approaches on all subtests. These differences 
fluctuate between one and three months for the LE children and remain 
constant at one month for the SC children except In Spelling where both 
groups achieved equally. 

When comparisons between children with and without kindergarten 
experience were made on the basis of method, there were seven signifi- 
cant differences favoring kindergarten children In the LE and LE-AV 
classes and four favoring the kindergarten group In the BR and PV classes 
(Table 5.40). Specifically, LE kindergarten children did better on 
Word Reading, Paragraph Meaning, Vocabulary and Spelling at the »01 
level; LE-AV kindergarten children on Vocabulary and Word Study Skills 
at the .01 level and Spelling at .05; BR kindergarten children on Vocab- 
ulary, Paragraph Meaning and Word Study Skills at .05; and PV kinder—- 
gar ten children on Paragraph Meaning at the .01 level* Grade equivalent 
scores were not substantially higher for the kindergarten children, aver- 
aging one month, and never exceeding two months except on Spelling. 

Achievement In the Second Grade 

Treatment of the kindergarten data In obtaining CRAFT 2 results was 
Identical to that reported above for CRAFT 1, except that the MAT Pri- 
mary II, Form C was used In CRAFT 2. 

Results of the 28 comparisons made for the total population of 
kindergarten and non— kindergarten children reyeal that the kindergarten 
children did better on all but one comparison, and 15 of these differ- 
ences were significant (Table 5.42). The one comparison which favored 
the non-kindergarten group was on the Spelling sub test for children in 
the PV classes. 

As In the first-grade study, second-grade kindergarten children did 
significantly better than children without such experience when compari- 
son Is made for all methods combined. Mean raw scores of 19.02 on Word 
Knowledge and 24.49 on Reading were significantly better at the .01 than 
means of 16.88 and 21.19 achieved by non-kindergarten children. Kinder- 
garten children did significantly better than -their classmates at the * 
.05 level on Word Discrimination and Spelling. Translated into grade 
equivalents , the differences between the two groups favor the kindergar- 
ten children by two months on Word Discrlffllnation and by one month on 
the other three sub tests. This indicates that the sll^t advantage held 
by kindergarten children at the end of the first grade was maintained 
through the second grade (Table 5.43). 

When children are compared on the basis of approaches, it is evi- 
dent that differences between kindergarten and non-kindergarten 
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children in the LE Approach were greater than in the SC Approach. 

The differences are significant for the former on all four subtests, 
while no significance exists for the latter. Grade equivalent means 
indicate an advantage of three months on three of the subtests for 
kindergarten children in the LE Approach, and a difference of one 
month on Word Knowledge. In the SC Approach the mean of 2.6 for kin- 
dergarten children on Word Knowledge was two months better than that 
for the non-kindergarten group, and the former group did one month 
better than the latter on Word Discrimination and Reading* There 
were no -differences in Spelling. 

Comparing the children within methods, it is apparent that the 
advantage gained by children in the LE Approach can be attributed 
largely to the gains made by kindergarten children in the LE Method. 
These children had an average raw score advantage of 4.59 which, 
translated into a grade equivalent, approximates three months. Kin- 
dergarten children in the LE-AV Method scored an average of 2.95 
points higher, or 1.5 months per subtest. Differences favoring kin- 
dergarten children in the BR Method and PV Method averaged two months 
and one month respectively. Comparisons for children within the meth- 
ods reveal significant ^-test differences for kindergarten children 
in the LE Method on all four subtests, in the BR Method on two sub tests 
and in the LE-AV Method on one sub test. All but one of these are at 
the .05 level. 

In summary, kindergarten children achieved consistently higher 
reading scores, through the second grade th^ non-kindergarten chil- 
dren. Having had kindergarten experience was more advantageous to 
children in the LE Method than to children in the other three methods. 



6. Results for Early Readers 

The early reader in this study was defined as the child \dio 
entered first grade with the ability to identify words, no matter how 
few, or who acquired this skill during the first month of school. 
Identification of these children was made by classroom teachers. The 
purpose behind such identification was twofold: to determine whether 

the reading children assigned to the two approaches were comparatively 
equal in pre-reading ability; and to establish whether or not the 
early readers ultimately achieved any better than their classmates. 

Teachers had listed 58 CRAFT 2 children as early readers: 33 in 

the SC Approach and 25 in the LE Approach. Because of these small 
numbers^ children were not further separated by method and therefore 
an analysis of their achievement includes only comparisons between 
. early readers and the total CRAFT population, and comparisons between 
approaches. 

A check on the validity of teacher’s selections was made by ad- 
ministering the Detroit Word Recognlti n Test to children identified 
as early readers. Scores indicated that of the 39 children in 



CRAFT 2 who had taken that test, 32 had been able to identify one or 
more words* The seven children who could not identify any of the test 
items were retained in the early reader group when an examination of 
their performance on other pretests revealed that they had scores con- 
siderably better than the means for the total population. The 19 
children who missed the Detroit test were also retained. 

Results for early readers on CRAFT 1 tests are shown in Table 
5.44. As a group, the early readers had scores on the Murphy-Durrell 
Readiness Test which placed them above the 50th percentile on all sub- 
tests with the exception of Phonemes, in which they achieved at the . 

14 percentile rank (Table 5.44). Comparing their scores with those 
of the total population reveals significant differences at the .001 
level favoring the early readers on all components of the Murphy- 
Durrell Readiness Test as well as on the Metropolitan Readiness Test 
and the Thurstone Pattern Copying and Identical Forms Tests. 

The early readers in the SC and LE Approaches had on the average 
significantly higher scores on all of the pretest measures than the 
total groups participating in those approaches. All but three of the 
differences were significant at the .001 level (Tables 5.45 and 5.46). 

A between— approach comparison of early readers indicates that 
children in the SC Approach had slightly higher scores on all measures 
of the Murphy-Durrell Readiness Test, but none of these differences 
reached significance. Conversely, children in the LE Approach had 
slightly higher scores oh the Thurstone and Metropolitan tests, and 
on the Word Meaning subtest of the Metropolitan scored significantly 
higher than their peers in the SC Approach (Table 5.47). 

Thus results of pretest measures reveal that as a group early 
readers were superior to the total population, but relatively equal 
when compared on an approach basis. 

When the posttests were given at the end of the first year the 
early readers maintained their superiority over the total group. Dif- 
ferences on all subtests of the Stanford were significant at .001 
level* Early readers in each of the two approaches similarly sur- 
passed their classmates within the same approach. Translated into 
grade equivalent scores, the differences between early readers and the 
total group average four months per sub test* The early readers had 
grade scores ranging from 1.7 to 2.0, whereas the mean grade scores 
for the total group ranged from 1.4 to 1.6 (Table 5.48). 

When early reader scores were compared on an approach basis 
neither group showed any consistent superiority. The SC children did 
slightly better on Paragraph Meaning, Spelling and Vocabula^, and 
the LE children were slightly ahead on Word Reading and Word Study ^ 
Skills. None of these differences is statistically significant (Table 

5.47). 
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Using grade equivalents, the SC children held a one month advan- 
tage on Paragraph Meaning and two months on Spelling, and the LE 
children scored one month higher on Word Study Skills. Means within 
both approaches were no lower than 1.7 and no higher than 2.1, and 
the average score of 1.85 Is slightly higher than the normative mean 
of 1.8 at the time the test was administered (Table 5.49) « 

At the end of the first year, then, early readers taught the 
SC and LE Approaches were approximately equal In performance, but 
evidenced considerably higher scores than the total CRAFT popula- 
tion, and were slightly ahead of the national norms. 

Results for the Second Grade 

Thirty-two of the original 58 early readers took the city-wide 
Metropolitan Achievement Test (Primary I, Form B) In October, 1965; 

17 In the SC Approach and 15 In the LE Approach. The two sub tests. 
Word Knowledge and Reading, were administered by the classroom 
teachers and scored by machine; grade equivalent scores were reported 
(Table 5.50). 

These scores indicate a trend favoring children in the SC Ap- 
proach on the Reading subtest. A difference of four months existed 
favoring this group, but b^qhuse of the small numbers of children 
tested this difference was riot significant. 

Upper Primary Form C of the MAT was given in April of the second 
grade (Table 5.50). There were no significant differences between 
the two approaches on the April tests, although SC children did 
slightly better on three of the subtests. Word Knowledge, Word 
Discrimination and Spelling, and slightly less well on Reading. Con- 
verted into grade equivalents these differences were never greater 
than one month (Table 5.51). However, the mean of 2.8 on Reading 
for the SC group and 2.9 for the LE group represent a reversal of 
differences from the October testing period. On the same October 
tests the early readers held an advantage of seven months and six 
mo nths over the total population on Word Knowledge and Reading tests 
respectively (Table 5.50A). Again in April the superiority of the 
early readers prevailed with differences which are significant at 
the i 001 level. When means were converted into grade equivalents 
(Table 5.50A) early readers averaged nine months higher than the total 
population for the four sub tests. Their mean grade score of 3.3 far 
surpassed the mean of 2.4 for the total population, and is also con-_ 
slderably higher than the norm of 2.7. 

Comparisons between SC early readers and the total population 
in the SC classes, and between LE early readers and the total popula- 
tion in the LE classes, also show significant differences between . the 
groups on all sub tests at the .01 level (Table 5.52). . 
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The early readers, like the total CRAFT population, did not 
score as high on reading comprehension as they did on tests measuring 
aspects of word recognition and word reproduction. The difference 
was greater in second grade than near the end of first grade. It 
seems reasonable to conclude that the early readers mastered the 
skills of word recognition readily, but were not as able in compre- 
hension, in which the linguistic and cultural handicaps common to 
the total CRAFT group were probably more significant. 

In summary, the early readers were well ahead of the rest of 
the CRAFT 1 population on the first-grade pretests, achieved signi- 
ficantly higher on the first-grade posttests, and increased their 
lead during the second grade. Whether this was the result of early 
teaching, or simply that both early reading and superior later scores 
were natural outcomes of superiority in readiness, cannot be deter- 
mined from the analysis above. 

7. Analysis of Teacher *s Use of Time as Revealed by Dally Logs 

The mean times for each teacher were obtained by computer from 
25 logs, based on five consecutive teaching days per month for five 
months, normally during the third week of the month. 

The results for total instructional time are shown in Table 5.53. 
The SC teachers averaged 162.75 minutes per day as compared with 
194.88 minutes for the LE teachers, a highly significant difference. 
For all 38 teachers combined, the mean of 177.96 minutes came close 
to the requested 180 minutes. 

The results for the major categories of Reading Activities and 
Supportive Activities are also shown in Table 5.53. The means for 
the 20 teachers in the SC Approach were 105.45 minutes for Reading 
(as compared to 90 minutes requested) and 57.30 minutes for Suppor- 
tive (as comphred to 90 minutes requested). Obviously the SC teach- 
ers spent somevrhat more time than requested on Reading, and much less 
than requested on Supportive. The differences between the Basal 
Reader and Fhonovlsual teachers were small and not significant. 

For the 18 Language Experience teachers, the totals were 95.50 
minutes for Reading Activities and 99.38 minutes for Supportive 
Activities. Thus the LE teachers averaged 10 minutes less per day 
on Reading Activities and 42 minutes more per day on Supportive 
Activities than the SC teachers. Between the two LE Methods, the 
LE teachers averaged seven minutes per day more on Reading Activities 
and 15 minutes per day more on Supportive Activities than the LE-'AV 
teachers. 

The mean times for the six Reading categories and 11 Supportive 
categories are shown in Table 5.54. Considering the Reading Activi- 
ties first, the great differences between the SC and LE approaches 
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are clearly evident. The SC teachers averaged 50.22 minutes per day 
In Basal Reader Activity, as compared to 3.12 minutes for the LE 
teachers. The LE teachers had a mean of 34.81 minutes on Individu- 
alized Reading, compared to 7.76 minutes for the SC teachers. For 
Experience Charts the means were 6.21 minutes for SC teachers and 
15.94 minutes for LE teachers. The LE teachers tended to spend more 
time on Sight Word Drill (13.60 minutes vs. 9.90 minutes) while the 
two approaches were essentially even In Other Reading and only 
slightly different In Phonic Activity. 

When the Basal Reader and Fhonovlsual methods are compared, the 
distinctive differences between these two SC methods are apparent. 

The BR teachers spent more time on Basal Reader Activity (54.67 min- 
utes vs. 45.76 minutes) and on Other (16.11 minutes vs. 6.04 minutes). 
The Fhonovlsual teachers spent far more time on Phonic Activity 28.57 
minutes vs. 12.42 minutes). The two methods did not differ signifi- 
cantly on the other three Reading categories. 

In Supportive Activities the two Skllls-Centered Methods were 
generally quite similar. Both spent less than half as much time on 
Science and Social Studies than the 30 minutes for each that had been 
requested ± Of the various language arts activities, both spent the 
most time on Writing. The deficit In Supportive Activities time Is 
largely due to the Social Studies and Science categories. 

When the LE and LE-AV Methods are compared, there are no signi- 
ficant differences In the pattern of Reading Activities. It should 
be noted that In the CRAFT 2 LE classes Individualized Reading dis- 
placed Experience Charts as the main reading activity. Involving 
35.00 (LE) and 34.62 (LE-AV) minutes per day as compared to 18.30 
(LE) and 13.58 (LE-AV) minutes per day. It should be noted also that 
both LE methods devoted more time to Phonic Activity (16.25 minutes 
and 15.23 minutes) than the BR teachers (12.42 minutes), although less 
than the PV teachers (28 .$7 minutes) 

In the Supportive Activities, the LE-AV teachers spent consider- 
ably more time on Audlo-^Vlsual Activities and Audio-Visual with Inter- 
mittent Discussion. The LE teachers spent more time than the LE-AV 
teachers on Listening to Stories, Discussion, Writing, Art Work with 
Reading, and Other Language Arts. The two groups of teachers were 
not differentiated on Listening to Poetry and Dramatization. 

These findings Indicate that there were substantial differences 
among the four methods In the way each group of teachers used Instruc- 
tional time. In addition, there were also substantlaT differences 
among the ^teachers within each of the four methods, as shown In Table 
5.53 by the large standard deviations. The largest standard deviation 
In that table Is for the Basal Reader teachers on All Activities. 

Their mean was 163.50 minutes, with a standard deviation of 34.43 min- 
utes; since the mean plus and minus one standard deviation Indicates 
the approximate range of the middle 68 per cent, one can conclude that 
the middle two-thirds of the Basal Reader teachers varied between 129 
minutes and 198 minutes; a quite substantial range. 
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It seemed worthwhile to check whether these rather sizable dif- 
ferences In use of time were related to differences In class achieve- 
ment. This has been done by correlating each Log score with adjusted 
class means on the MAT, first for the total group of 38 teachers, and 
then for each of the four methods. The results of these correlation 
studies are presented In the next two sections. 

Correlations with Achievement for All Teachers Combined 

An Intercorrelatlon matrix of 73 x 73 variables was computed for 
the total group of 38 teachers. The eight criterion variables were 
the second-grade MAT subtest class means adjusted on the basis of tl^e 
first-grade pretests (variables 66-69); and the second-grade MAT sub- 
test class means adjusted on the basis of the first-grade posttests ; 
(variables 70-73). The former are measures of class learning for the 
two-year period, with Initial differences In readiness partlalled but. 
The latter four are measures primarily of achievement In the second 
grade only, since the means haye been adjusted to eliminate the dif- 
ferences found on the first-grade posttests. The correlations of the 
73 variables with the eight achievement measures are shown In Table. 
5.55. The 20 variables derived from the Dally Log are numbered 30 
to 49 In this table . 

Considering the major categories first, the i*s with achieve- 
ment for Total Time per day and Reading Activities time are consis- 
tently small and not significant. For Supportive Activities time. . 
the are consistently negative, although only the jc*s with Spell- 

ing (-.32) are just high enough to reach significance at the .05 level 
of confidence. 

In CRAFT 1, correlations with achievement were positive and sig- 
nificant for Reading time, and were not significant for Total time 
and Supportive time. In CRAFT 2, the positive relationship for Read- 
ing time disappeared and a slight negative relationship with Support- 
ive time appeared, which is significant only for the Spelling subtest. 

Reading time was subdivided into six categories: Basal Reader 

Time, Experience Chart, Individualized Reading, Sight Words, Phonic 
Activity, and Other Reading Activity (variables 33-38). Of these, 
only Other Reading Activity shows a significant correlation; it has 
positive although low correlations with Reading scores both adjusted 
for pretests (.32) and for posttests (.36). This would seem to sug- 
gest the desirability of a wide variety of reading activities. Of the 
48 correlations between the six Reading sub-categories and the eight 
achievement measures, 19 were plus and 29 were minus; this amount of 
variation from an even division of 24 and 24 is not statistically 
significant. 

Supportive Time was subdivided in CRAFT 2 into 11 Categories : 
Listening to Stories, Listening to Poetry, Discussion, Writing, Audio- 
Visual Activity, A-V with Intermittent Discussion, Dramatization, Art 



73 



Work with Reading, Other Language Arts, Social Studies, and Science. 
The last two categories (Social Studies and Science) were to be used 
only by the BR and PV teachers. These 11 categories are numbered 39 
to 49 in Table 5.55. 

An inspection of the r,*s for these 11 categories shows only one 
category that has significant correlations. Listening to Stories 
has consistently negative correlations with the four MAT sub tests. 
All four of the r’s with MAT adjusted by first-grade pretests are 
significant, and three of the four r*s with MAT adjusted by first- 
grade posttests are significant, at the .05 level. Thus it seems 
that in general, teachers who spent more than average time reading 
or telling stories to the children obtained below average results. 
The obvious implication seems to be: more reading by the children, 

less by the teachers. 

Of the 88 r.*s for these 11 categories, 63 are negative and 25 
are positive, as compared to a chance distribution of 44 and 44. 

This trend toward negative i*s is significant at the .01 level 
using (3il-Square. Thus, although most of the r.*s are individually 
insignificant, the tendency is for the sub-categories within Sup- 
portive Activities to have slightly negative correlations with both 
sets of achievement scores. When Social Studies and Science are 
omitted the trend is even stronger (59 out of 80) . 

Correlations with Achievement for the Approaches and Methods 

An effort to find out more about the relationship of instruc- 
tional time to achievement was made by getting the correlations 
between Reading, Supportive, and All Activities times, and the class 
means on the four MAT subtests adjusted by first-grade post tests. 
These correlations are shown in Table 5.56. 

In interpreting these i*s, one must note that the smaller the 
group of teachers, the higher the correlation must be in order to 
be considered significantly greater than zero. Thus, the .05 level 
of confidence Is reached for 38 teachers with an ^ of .32; for 20 
teachers, with an i of .44; for 18 teachers, with an ^ of .47; for 
10 teachers, with an jp of .63; and for 9 teachers, with an x of .67. 

Most of the correlations in Table 5.56 are not significantly 
greater than zero. There are only two apparently significant i*s. 
One is the ^ of -.66 between Reading Time and MAT Reading, for the 
FV teachers. This negative correlation is contrary to expectation; 
it tends to become more understandable when the correlations between 
the six kinds of reading activity and MAT Reading are examined, as 
will be done below. 

The other apparently significant correlation Is the of ”»69 
between . Supportive Time and Spelling, for the nine LE teachers. For 
this group of teachers the other for Supportive Time are similar 
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In direction, although smaller. Again, an explanation will be sought 
below In considering results for the 11 kinds of Supportive activi- 
ties. --.U 



It should be noted that In the CRAFT 1 analysis, Reading Time 
was significantly and positively correlated with adjusted reading 
scores; In CRAFT 2 this Is not generally true. 



Correlations of Specific Log Categories with Achievement by Method - 'i 

The correlations by methods were computed only for the MAT ^Word 
Knowledge and Reading subtests as adjusted by first-grade posttests. 
This adjustment minimizes the effect of first-grade achievement on 
second-grade, achievement. The results are shown In Table 5.57. ' 

Within the BR group there Is only one significant between 

Listening to Poetry and Reading. There were non-slgnlf leant but posi- 
tive ^*s between Sight Words and both reading scores (.62 and .57), 
and between Other Reading and both reading scores (.50 and ".45). 

For the FV teachers the most notable results are the negative 
X’s between Phonic Activity and both reading scores (-.61 and -.75) , 
the latter being significant. Apparently In this method a saturation 
point Is reached, and In second grade the PV teachers tended to get 
best results with least time spent on phonics. The negative r's for 
Phonic Activity account for the negative ^ Reading Time mentioned 
above. The ^ between Basal Reader time and Reading Is almost high 
enough to be significant (.59). ^ . 

In the LE group of teachers there was one significant .r,. -..68* . 
between Listening to Stories and Reading. This group of teachers : 
spent over 15 minutes per day on this category, and there Is a strong 
tendency for those who spent more time than that to gat poorer results. 
Seemingly substantial-appearing but non-slgnlf leant negative jr's 
were found for Art Work with Reading (-.55 and -.60), for Phonic 
Activity (-.50 and -.46), and for Writing (-.45 and -.43). The only 
positive ^*s of substantial magnitude are with Other Reading (.43 and 
.60). 

For the LE-AV teachers none of the r^'s was high enough to be sig- 
nificant. The largest x's are with Dramatization (.65) and Other 
Reading (.51). 

Whereas In CRAFT 1 the teachers who put most time Into activities 
distinctive to their teaching method tended to get the better results, 
this did not hold true In CRAFT 2. There Is no consistent pattern. 
There are slight Indications that the teachers who had considerable 
variety In their reading activities did well, and that large amounts 
of time spent on certain kinds of activities, idilch vary from one 
method to another, can be detrimental. 
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8. ATialvsls of the Resiilts of OScAR R_ 

Results of OScAR R In CRAFT 1 

For the official report of CRAFT 1 results, the 13 OScAR R 
scales were entered in a 54 x 54 intercorrelation matrix (Harris & 
Server, lif6a, p.88). The results were disappointing. The 13 
OScAR scales were correlated with adjusted class means on- the five 
Stanford sub tests and four adjusted individual tests, for the 48 
teachers in all methods combined, with not one of the resulting 117 
it’s significant at the .01 level. 

However, re-inspection of this table after publication disclosed 
a few r*s that were significant at the .05 level, and which had been 
overlooked. Most of these jr*s were based on all 48 teachers, but 
some of the OScAR R scales applied to only one of the two approaches 
and were based on 24 teachers. 

The Control scale had negative correlations with all five ad- 
justed Stanford scores, and two of these jc*s were significant at the 
.05 level (with Word Reading, -.30; and with Paragraph Reading, -.32). 
The Total Interchanges scale had significant jr*s with three Stanford 
scores (with Word Reading, .35; with Spelling, .32; with Word Study 
Skills, .33). The LE-AV scale had a positive correlation only with 
Vocabulary .( .42) . 

• Thus a reexamination of the CRAFT 1 OScAR R correlations turned 
up some leads that seemed worth exploring further. In particular, 
it seemed that the more disciplinary statements, the poorer the read- 
ing ■ scores ; a^^d the larger the number of pupil— teacher verbal inter- 
changes,, the better the learning of word identification skills. 

Subsequently a correlation analysis was done separately for each 
of the four CRAFT methods, using the first grade adjusted Stanford 
class means for the Word Knowledge and Paragraph Meaning subtests. 
These r*s are shown in Table 5.58. Since the number of teachers in 
each method was only 12 (11 in LE, because of extended absence of one 
teacher), an r must be at least .58 to be significant at the .05 
level. Some of the non-significant jr*s in the .40*s and .50 s may 
be meaningful for these teachers, even though the x does not justify 
high confidence that a similar result would be found with another 
group of teachers. 

The Empirical LE scale had a significant r. only with Word Recog- 
nition for the LE teachers. The Empirical SC scale had a significant 
r only with Paragraph Meaning for the LE-AV teachers; the A Priori SC 
Icale had an r of .54 (non-significant) for the same group and test. 
This result is difficult to explain. The two scales intended to dis- 
tinguish between the LE methods seem to have done so. The high AV 
scale has positive, significant jr*s for the LE-AV teachers and nega- 
tive, smaller Jf*s for the other LE teachers. This reinforces t e 
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conclusion based on analysis of the Logs, that spending time with 
AV procedures Is profitable ^en the teachers have had training In 
the use of AV equipment for the teaching of reading, but unprofit- 
able when the teachers have not had such training. The results of 
the low AV scale confirm this conclusion. In that the ^'s were plus 
for the LE teachers and minus for the LE-AV teachers. The rest of 
the scales based on teaching method did not turn up any significant ' 
relationships • 

The five scales based on the Dynamic side of OScAR R produced 
some Interesting findings. The Control scale, with generally nega-? 
tive ^ts highest ^ for the LE-AV teachers, =.78 with Para- 

graph Meaning. High Control scores. Indicating frequent efforts to 
maintain discipline, were negatively correlated with reading achieve- 
ment In three of the four methods, having r^'s close to zero only for 
the PV teachers. 



The Positive Motivation scale had positive r's with achievement 
for both LE methods, with one ^ of .58, and non-slgnlf leant r^'s with 
achievement for the SC methods. The Negative Motivation scale had a 
high (-.69) negative ^ with Paragraph Meaning for the LE-AV teachers, 
and the other three ^'s for the LE Approach are on the milnus side, 
although very small; ^'s for the BR and PV methods are positive, al- 
though not high enough to be significant. Thus, there Is a sugges- 
tion that reliance on praise and avoidance of scolding Is associated 

with good achievement In the LE methods, but not In the SC methods. ' 

> 

The Total Interchanges scale had ^'s.of .50 and .54 with Word 
Recognition In the two LE methods, and all eight were on. the plus 
side, reinforcing the low but significant t*s for the total group of 
teachers. 

The Per Cent of Meaningful Interchanges scale. Interestingly, 
had minus £*s for the BR Method and plus _r*s for the PV Method, sug- 
gesting that best results were obtained by the BR teachers who used 
more than an average amount of drill, and by PV teachers who used 
less than an average amount of drill, within their method. 

Results of OScAR R In CRAFT 2 

The OScAR R scores for the second-grade teachers are based on 
four sets of observations rather than eight as In the first grade, 
and therefore are probably somewhat less reliable. The mean scores 
for the four methods are to be found In the table giving means for 
methods for 74 variables (Table 5.59). The OScAR R variables are 
numbered 13 to 25 In this table. 

The mean scores for the four methods show a number of .differences 
large enough to be statistically significant (see Table 5.60). As 
would be expected, the BR and PV Methods were higher than the LE and 



LE-AV Methods on the Empirical and A Priori SC scales; and the 
A Priori LE scale was significantly higher for LE over both BR and 
PV. The Empirical BR scale distinguished between the BR and PV 
Methods and the Empirical LE high AV scale distinguished between 
the LE-AV and LE Methods. These differences were all in the expected 
directions and provide additional evidence of real differences in the 

teaching methods. 

The means for both Control and Negative Motivational Climate 
were significantly higher for the BR and PV Methods than for the LE 
Method, and BR was significantly higher than LE-AV on Control. BR 
was higher than PV on Per Cent of Meaningful Interchanges. Other 
differences between means were not significant at the .05 level. 

Correlations with Achievement . For the whole group of 38 teachers 
in CRAFT 2 a few significant r*s were found; OScAR R variables are 
numbered 17 to 29 in Table 5.55. The Empirical LE scale had consis- 
tently positive _r*® with the adjusted MAT means, and its _r with 
Reading was significant for both adjusted means. The Empirical SC 
scale had a significant negative r with Reading adjusted by post- 
tests, and the other r*s for this scale were all negative although 
smaller. The r*s for Control and Positive Motivation with Reading were 
not significant while the r for Negative Motivation and Reading was 

significant. *“ m c 

The r*s with achievement by method are shown in Table 5.ol. 

Several interesting trends are apparent. The Empirical LE Scale 
correlated positively with Reading for the BR and LE-AV Methods, but 
close to zero for PV and LE. Conversely, the Empirical SC Scale has 
a significant minus r for the BR teachers , and the Basal Reader 
Scale had minus ^*s for both BR and PV. Apparently the SC teachers 
who enriched their programs with language-experience activities 
tended to get better results than those who did not. The A Priori 
LE Scale had a significant negative r with Reading for the PV teach- 
ers, but positive, smaller X*® other three methods. Con- 

versely the Empirical SC Scale had a significant negative r with 
Reading for the BR teachers and smaller negative x*® 

The A Priori SC Scale had moderate negative x* ® 
teachers. 

These findings based on closeness of adherence to a specific 
way of teaching are not completely consistent, but they suggest 
that in CRAFT 2 those skills-centered teachers who enriched their 
programs with a considerable amount of language experience activity 
tended to get better results than those who adhered closely to the 
skills program with relatively little enrichment. For the LE and 
LE-AV teachers the relationships are less clear. Correlations with 
the two LE scales tend to be positive but below significance, sug- 
gesting that the LE teachers who emphasized typical LE procedures 
did better than those who deviated. The AV program in second grade 
seems not to have been very effective, even for the LE-AV teachers. 
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The scales from, the Dynamic side of OScAR R also showed some 
significant x*s. The Control Scale had generally negative ^*s With 
achievement, and these were slgnlf learnt for the PV and LE teachers. 

The Positive Motivation Scale had negative _r*s for the two SC Meth- 
ods (one reaching a significant level) and positive ^’s for the two 
LE Methods (one significant X of ,67 with Reading for the LE-AV 
teachers). The Negative Motivation Scale had negative x*s for the 
BR, PV and LE teachers, and four of the six r*s were significant. 
Finally, Per Cent of Meaningful Interchanges had negative r*s for ^ 
the BR teachers. 

These results suggest the following Interpretations: (1) Those 

teachers \diose lessons were punctuated with many disciplinary State- 
ments did not produce as good achievement as teachers who used such 
remarks less frec^uently, (2) In the SC Approach a high free^uency of 
motivating comments , whether positive or negative , was associated 
with poor results, with the evidence clearer for negative mbtivatlon. 
(3) In the LE Methods negative motivation tended to be associated 
with poor results . (4) In the LE-AV Method both positive and nega- 

tive motivation scores tended to be related to achievement; pbssibly 
this is an Indication of teacher effort in this method, which. suf- 
fered for lack of consultation and equipment during CRAFT 2, 

The correlations with achievement of the various OScAR R scales 
Indicate that some of the dlm^enslons were significantly related to 
achievement, and that these varied somewhat from method to method. 

The main finding is that the Control and Negative Motivation scales . 
tended to be negatively correlated with reading achievement. This 
does not prove a causal relationship. It may be that high Control 
and Negative Motivation scores show efforts by the teacher to- con- 
trol behavior which was Itself a response to ineffectual teaching « 
Another finding is that SC teachers who enriched their programs with 
a variety of reading and language arts activities obtained more 
growth In reading than those who did not. 

9. The San Diego Teacher Inventory 
of Approaches to the Teaching of Reading 

In June of 1965, before the second-grade instructional program 
began, second-grade teachers using the LE Method had the highest 
score on the Basic Scale (44.33) indicating ^preement with that ap- 
proach to reading, \dille teachers in the other three methods had 
scores indicating a tendency toward agreement (Table 5.62). Teachers 
In all four methods indicated a tendency to agree with the Indivi- 
dualized and Language Experience scale with the LE-AV teachers scor- 
ing highest (43.11 and 42.77 respectively) on both scales and PV 
teachers scoring lowest (36,40 and 34,00). 

When a statistical analysis was made for the mean scores among 
method groups, there were five significant differences (Table 5.63) 
These favored the LE and BR teachers over the LE-AV teachers on the 
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Basic Scale, the LE-AV teachers over the PV and LE teachers on the 
Individualized scale, and the LE-AV teachers over the PV teachers 
on the Language-Experience scale. Comparing the results between the 
two main approaches, the SC teachers scored somewhat higher on the 
Basic scale and lower on the Individualized and Language-Experience 
scales^ but the differences were not significant. 

When the San Diego Teacher Inventory was given again at the 
conclusion of the year, significant changes in the attitudes of 
teachers were found (Table 5.62). This was most notable in the case 
of the LE teachers. A drop in their mean score on the Basic scale 
from 44.33 on the pretest to 34.22 on the posttest is significant 
at fh ** .01 level, ^ile changes from 37.44 to 43.88 for the Indivi- 
dualized, from 37.11 to 44.22 for the LE Scale were signifi-. . 
cant at the .05 level. These scores indicate a change in attitude 
for these teachers from a greater commitment to the basal reacing 
method at the beginning of the study to a closer identification 
with the LE method at the end of the year. 



Significant changes were also found for teachers in the BR 
Method. They evidenced less affiliation with the Individ^lized 
Scale at the end of the year, and their mean score of 31.80 on the 
Language-Experience Scale indicated a tendency to disagree with that 
method by the time of the posttest. Phonovisual teachers moved from 
a tendency to agree to a tendency to disagree with the Language- 
Experience Scale* significant at the .05 level, ^e ^E-AV 
teachers showed a significant change on the Individualized Scale 

from 43.11 to 47.00. 



As might be expected from the foregoing, between-method compar- 
isons reveal numerous significant differences on the 
ing the BR and PV methods on the Basic Scale and the LE and LE-AV 
methods on the Individualized and Language-Experience Scales (Table 

5.64). 

\ 

A review of the results indicates that most teachers were more 
favorably disposed toward the method they were using by the conclu- 
sion of the study than they were when the school year began. Fur- 
thermore, the teachers showed less agreement with other^ scales than 
they did with the one ^ich reflected the philosophy behind the ap- 
proach they were using. 

of San Diego Scales to Pupil Achie vement 



Intercorrelatipn matrices computed within methods, including 
the teachers ' scores on the three San Diego scales and eight 
achievement measures (four adjusted by. first-grade pretests and 
four adjusted by first-grade posttests) , indicated no significant 
relationships between the measures. Another intercorrelation 
matrix .including San Diego scores of all teachers, irrespective 
of method, was computed. A section of this 73 x 73 variable 
matrix showing correlations of the San Diego scores with the eight 
adjusted MAT scores may be found in Table 5.55. 
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Results of the matrix computed by method reveal little In the 
way of significant relationships between teacher attitude and pupil 
achievement. The correlations, although occasionally substantial,, 
do not quite approach statistical significance because of the small 
number of. teachers participating In any one method (9 or 10). 

The three significant relationships fotmd were between ^ San 
Diego posttest scores and achievement variables adjusted by first- 
grade posttests.. Two of these occur between PV teachers' scores on 
the Basic Scale and results on the Reading and Spelling, subtests. 

Both correlations are negative (-.71 and -.65) and significant at 
the .05 level. All other correlations for the Basic Scale. for PV 
teachers are also negative. These negative ^'s contrast with the 
positive ones made at the time of the pretest, when the attitude of 
the teachers toward the Basic Scale was significantly less favorable 
than It was at the conclusion. This would seem to Indicate that a 
class's achievement In reading tended to decrease as the teacher's 
enthusiasm for the PV Method Increased. Here, as In the Logs, where 
the jr between the time PV teachers spent on Phonic Activities and 
Reading scores was significantly negative (-.61 and -.75), It might 
be hypothesized that children were overexposed to components of 
the PV Method reacted negatively In consequence. This hypothesis Is 
reinforced when one notes also that PV teachers became significantly 
more accepting of the Basic Scale as the study progressed, and at 
the time of the post test the mean of 46.80 made by PV teachers on 
this scale was the highest of the four groups, and Indicated strong, 
agreement . 

The other significant relationship was that for the LE-AV 
teachers between the Language Experience Scale and Reading, .64. All 
other LE-AV x's for this scale are also positive, suggesting that 
teacher degree of acceptance of language-experience thinking was re- 
lated to good results within the LE-AV Method. 

Among the BR teachers there was no significant change In the 
Basic scale from pretests to poattests. There 

were no significant relationships between any of the scales and 
achievement measures. However, on the San Diego post test there were 
consistently plus correlations between the Individualized scale and 
all eight achievement measures for this group . These jr ' s ranged 
from .25 to .45. Somewhat lower ^'s, ranging from .14 to .36, were 
found between the Language-Experience Scale scores for the BR teach- 
ers and achievement; their Basic Scale ^'s were all very low (.00 - 
.23). 

Similarly, correlations for the LE teachers were negligible when 
comparisons are made between the Language-Experience and Indlyldu** 
allzed Scales and second grade achievement. However, the. negative 
results for these same teachers, ranging from -.30 to -.45 on all 
achievement variables, may well reflect the difference In the pre- 
and posttest scores made by these teachers on the Basic Scale. It. 
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may be recalled that this difference, which favored the Basic Scale 
at the pretesting, was significantly less so at the time of post- 
testing. 

On the larger 73 x 8 Table (Table 5.55) there are no signifi- 
cant relationships between the San Diego scales and achievement, and 
all jc*s are low. This could be expected since the scores of all 
teachers were used, irrespective of method or approach. 

In suimnary^ strong commitment to Basic methodology correlated 
negatively with achievement for the PV teachers, and not significantly 
for the other three groups. The LE-AV teachers whose classes did well 
on Reading scored relatively high on the Language Experience Scale. 

For the total group of 38 teachers there is no San Diego Inventory 
pattern that goes with superior or inferior results. 



10. Other Variables 

Most of the variables that were correlated with adjusted post- 
test clAss means (Table 5.55) have already been discussed. There are 
in that table a number of other variables to consider. Nearly all of 
these had ^'s with achievement that were of negligible size. 

The two community measures, median year of education of adults 
and median adult income, did not show t*s significantly greater than 
zero . 



A number of teacher variables had non-significant, very small 
^*s: age, educational level, type of teaching certificate, total 

experience, second-grade experience, marital status, and number of 
children. Teacher absence had consistently negative jc*s with achieve- 
ment and seven of the eight £*s are significant but low. Teacher 
quality rating, which was a combination of global ratings on a one 
to five scale by the assistant project director and the district read- 
ing consultant, had x*s that were all positive but ranged only from 
.06 to .28, and none were significant. 

Another teacher variable that had x * s approximating zero was 
teacher-pupil similarity in ethnic background; the £*s ranged from 
-.01 to .09, showing that it made no difference in pupil attainment 
whether the teacher was white or Negro. Finally, on the Teacher Atti- 
tude Toward CRAFT Method Scale all of the i*s with achievement were 
positive and two (Word Knowledge and Reading, adjusted by pretests) 
were significant. Since there were no significant differences among 
methods on this scale, this means that in all methods teachers whose 
pupils did well tended to like the method better than teachers whose 
pupils did poorly. 

Pupil absence in first grade had negative but extremely low, non- 
significant £*s. Pupil absence in CRAFT 2 had seven non-significant 
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r^'s and one that barely reached significance at the .05 level; a 
positive £ of .33 with Spelling adjusted by posttests. The only 
plausible explanation Is that this may be one of the extreme fluc- 
tuations from zero that tend to occur occasionally If one computes 
enough r,’s. 

Class size had consistently negative but extr^ely low jr's with 
achievement both for the CRAFT 1 year and In CRAFT 2. Finally, the 
per cent of CRAFT children In the class had f's too low to be sig- 
nificant. 

In general, then, the only one of these variables that had a 
consistent relationship with achievement was teacher absence. Classes 
whose teachers were regularly present tended to do better than 
classes whose teachers had high absence rates. 
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CHAPTER VI 



THE THIRD GRADE FOLLOW-UP 



The plan for the CRAFT Continuation included a follow-up study 
to be conducted when the pupils^ were in the third grade. Since it 
was anticipated that by April of the third grade (when city-wide 
reading tests are given) there would be too few CRAFT children re- 
maining in their original schools to make possible a control of 
teaching method, the follow-up study was designed to locate as many 
as possible of the original CRAFT children and to collect and analyze 
their third-grade scores on tests of reading achievement. 



1. Procedures for CRAFT 3 



Procedures for keeping track of the children who left CRAFT 
classes during first and second grades have been described in Chap- 
ter I. In the fall of 1966 many weeks were spent in setting up a 
school-by-school record of the CRAFT children. Of the 1,378 chil- 
dren who had taken the first-grade pretests, 1,128 were located 
(Table 6.1). Two hundred fifty children could not be located; either 
they had moved out of New York City, or their moves had not been re- 
corded properly. Of those located, 696 were still attending the 
CRAFT schools in which they had started first grade, and 432 were in 
other schools (see Figure 3). 

The distribution of the located pupils by method and approach 
is shown in Table 6.2. The distribution among methods was fairly 
even, although the PV Method had a slightly larger number still in 
CRAFT schools. 

Table 6.3 shows the group and grade distributions of the 1,128 
children \dio were located. Group I Includes the main CRAFT experi- 
mental population, those children who were in the CRAFT project from 
the first-grade pretests through the second grade posttests and who 
were Included in the CRAFT 1 and CRAFT 2 analyses. Of the 598 chil- 
dren in Group I, 46 were in Grade 2, one was in Grade 1, and 17 were 
in special classes that do not take the city-wide achievement tests. 
The main third-grade analysis is based on the 489 children in Group I 
for whom scores were found on the third grade Ifetropolltan Reading 
Test given in April, 1967. Supplementary analyses were made for 
those who had scores on the MAT as of October, 1966 (early in third 
grade) and on the New York State Reading test for Third Grade, also 
given in October, 1966. 

Group II in Table 6.3 Includes 371 children who were in the 
CRAFT Project in the first grade, but left the CRAFT school between 
the first-grade posttests and the second-grade posttests. Those 
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children, then, all had one year in the CKAFT classes (up to first- 
grade testing in May) , and many of them had spent part of the second 
grade In CRAFT classes. 

Group III Includes 140 children Who took the first-grade pre- 
tests, hut left the project before . the first-grade posttests. They 
are, in consequence, children wit:h minimal exposure to CRAFT teach- 
ing methods. Who were not included in either the CRAIT 1 or CRAFT 2 
analyses . 

It should he noted that 101 children were located In second- 
grade classes and six In first-grade classes, a total of 107 who had 
experienced non-promotion. In contrast, four children were located 
in fourth grade and two In fifth grade, well under one per cent who 
had experienced acceleration. 

The lower part of Table 6.3 shows the kinds of classes in which 
the children were located In 1966-67. Of the total 1,128 children, 
1,080 were In regular classes and 48 (about four per cent) were in 
special classes in which the city-wide reading tests were not given. 

Of the children listed in Table 6.3, those who were in grades 
other than grade three, those \Aio were in special classes, and those 
idiose third-grade test scores were missing were excluded from the 
CRAFT 3 analyses below. 

The necessary exclusion of the children not in regular third- 
grade classes mainly removed children who were in the lower half of 
the distribution of reading ability, and means based on the remain- 
ing childre’^ are probably a little higher as a result of their exclu- 
sion. 

Tests 



Three reading tests were given city-wide in New York City third- 
grade classes during 1966-67. The Metropolitan Advanced Primary, 

Form B, was given in October, 1966, with separate answer sheets that 
were scored by Harcourt, Brace & World Co. The New York State Read- 
ing Test was administered state-wide, also in October; this test pro- 
vides raw scores and percentiles, hut no grade scores. The Metropol- 
itan Elementary Reading, Form A, was administered city-wide in April, 
1967, with separate answer sheets which were scored by Harcourt, 

Brace & World Co.; scores became available late in June. For brevity 
these April reading tests will he referred to below as CRAFT 3 tests. 
The Arithmetic Concepts sub test of the MAT was also given in April, 
1967, and scores on it were obtained. 

Teaching Method 

No attempt was made to maintain any control over the assignment 
of CRAFT children to third-grade classes, or to influence third-grade 
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teaching methodology. Thus, It may be assumed that the classifica- 
tion procedures and teaching methods In third grade were representa- 
tive of common practice In New York City el^entary schools with 
disadvantaged Negro pupil populations. It Is customary In such 
schools to utilize a modified form of ability grouping; often there 
are two main ability groups In a class, and some overlapping of 
ability levels between classes. Thus, the heterogeneous grouping 
In effect In the CRAFT Project through the first and second grades 
was not maintained In the third grade. 

Most third-grade teachers In New York City use basal readers, 
but there Is considerable variation In the degree to which the accom- 
panying manuals are followed. General policy f — ^ors using a reader 
appropriate for the reading level of the group, which for some chil- 
dren Is considerably below grade placement. 

During 1966-67 , although new basal readers purchased were mainly 
of series emphasizing city life and an Integrated cast of characters, 
a majority of third-grade classes were probably still using older 
books. Official encouragement was given In the city syllabus to In- 
tegrating reading Instruction with other language arts and to the 
utilization of a variety of enrichment activities. Including Individu- 
alized Independent reading. 

Since there was no evidence that either pupil classification 
policies or Instructional methods In third grades In the CRAFT schools 
were different from the third-grade policies and methods In the many 
elementary schools to which CRAFT children had transferred, the chil- 
dren who were In CRAFT methods through the second grade (Group I) are 
considered to have been In third-grade classes that were similar, re- 
gardless of whether they were In CRAFT schools or In other schools. 

The children In Group II (at least one year In a CRAFT class) are 
also assumed to have been In similar Instructional programs In second 
and third grades. 

Statistical Treatment 



For Group I, raw score means were computed for each of the three 
tests given during the third grade. In addition, the April MAT read- 
ing tests were adjusted by a procedure similar to that used In CRAFT 
2. The same four first-grade pretests employed In CRAFT 1 and CRAFT 
2 adjustments were used as predictor variables In a multiple regres- 
sion equation, and a predicted score was computed for each pupil. 

The pupil's obtained score was adjusted for the disparity between 
obtained and predicted score, and means and standard deviations for 
the adjusted scores were obtained for approach and method. This was 
done for each sub test. Group results were also obtained for boys and 
girls, for the early readers, and for children with and without kin- 
dergarten experience. In addition, the April MAT scores for Group I 
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were adjusted on the basis of CRAFT 2 posttests, in an attempt to 
partial out pre-third grade learning differences and thus to high- 
light the amount of reading growth in third grade. 

The Child as a Unit. 

Reasons were given in Chapter III why the class was used as the 
statistical unit in the main CRAFT 1 and CRAFT 2 analyses. Since 
the children in each classroom were all exposed to the same teaching, 
anA differences among teachers in eadi method were found to be large 
and Inmortant, the class seemed the appropriate unit. In drawing 
comparisons between CRAFT results and those of other comparative stu- 
dies of reading methods, it should be noted that differences between 
means which were no larger than those found in CRAFT have been re- 
ported as significant in studies using the pupil as a unit, ^ile the 
CRAFT analysis using the class as unit: found them non-significant. 

In CRAFT 3 there were no longer any class units. Even the chil- 
dren who remained in the CRAFT schools were assigned to thii^-grade 
classes on the basis of criteria other than CRAFT method. 
who had moved to other schools were scattered through many different 

classes. 

It has been necessary, therefore, to use the child as the statis- 
tical unit in the CRAFT 3 analyses. Because the number of degrees of 
freedom is far greater ^en based on number of children than when 
based on a much smaller number of classes, it may be expected that 
some rather small differences may be found to be significant. This 
complicates comparison of third-grade results with first and second- 
grade results, since different criteria of significance were used. 

In an effort to correct for this change of criteria, 
will be paid to the size and consistency of direction of CRAFT 3 dif- 
ferences, as well as to the question of statistical significance. 



2. Pretest Results 

The results of Group I on the first-grade pretests are shown in 
Table 6,4. Considering first the totals for t**® 
means for the LE Approach were slightly higher than those for the 

Approach on all four pretests. 

Within the SC Approach, BR surpassed PV slightly on two 
tests and was slightly lower on two pretests; 

two methods were, therefore, approximately equal in J^^^^tial aMlity. 
Within the LE Approach, LE was slightly higher than LE-AV on two pre- 
tests and lower on two, showing approximate equality. 

Sex differences were not consistent. Boys and girls were approx- 
imately equal on one pretest, boys scored slightly ^^8^®’^ PJ®“ 

tests, and girls scored slightly higher on one pretest. This confirms 
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the CRAFT 1 report In which each sex was ahead on three pretests, and 
all differences were too small to be significant (Harris & Serwer, 
1966a, p. 87). 

The pretest results for Group II are shown In Table 6.5. In com- 
parison to Group I, Group II had a higher mean on one pretest, an 

equal mean on one, and lower means on two. The differences between 
the two groups were small and this fact supports the conclusion stated 
in the CRAFT 2 analysis that the CRAFT 2 children were a representa- 
tive sampling of the CRAFT 1 population. 

Pretest insults for Group III, the smallest group, are shown In 
Table 6.6. They surpassed Group I on two pretests, did equally well 
on one, and did less well on one. Again, the results s;.^pport the con- 
clusion that the children who remained, in CRAFT and those who left 

were approximately equal In readiness for reading. 



3. Group I Results 

Since children in Group I were exposed to the specific CRAFT 
teaching methods in both first and second grades, they constitute the 
main experimental population. The raw scores. for this group on the 
October, 1966, reading tests are shown In Table 6.7. 

On the MAT In October, the mean for the SC Approach was slightly 
higher than the LE Approach mean on both Word Knowledge and Reading. 
The differences were small, amounting only to one point of raw score, 
and not significant. Wa.whin the SC Approach the PV Method slightly 
surpassed the BR Method on both subtests by about two points. Within 
the LE Approach the LE Method was slightly ahead of LE-AV on both 
sub tests. Girls had a slight advantage over boys in Word Knowledge 
in all methods except BR. On the Reading sub test, girls had a sub- 
stantial advantage over boys in PV, LE, and LE-AV, and a slight ad- 
vantage In BR. 

On the New York State tests, given in October, the SC Approach 
means were slightly higher than the LE Approach means in Word Recog- 
nition, Reading Comprehension, and Total; but the differences were 
very small in comparison to the variability within approaches. PV 
was slightly higher than BR, and LE was slightly higher than LE-AV. 
Girls had higher means than boys. All of the mean differences were 
small enough to be of no practical consequence. 

April Results 

The main third-grade test was the Metropolitan Elementary, Form 
A, administered city-wide in April, 1967. The raw score results for 
Group I are shown in Table 6.8. The Arithmetic Concepts scores were 
collected and analyzed to check whether the method of instruction in 
reading had any significant relation to achievement in arithmetic. . 
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The Tnoflpg for the two approaches in arithmetic are sufficiently 
close (SC, 23.22; LE, 23.90) so as to rule out any differential 
effect on arithmetic for either approach. Among the methods, BR 
was lower than PV by three points, a difference that is signifi- 
cant at the .05 level. Boys were slightly ahead of girls in BR, 

PV, and LE Methods, and the sexes were approximately even in LE-AV. 
The differences between pairs of means, however, are too small to 
be significant at the .05 level. 

Turning to the reading sub tests, on Word Knowledge the mean 
for the LE Approach was 0.7 points higher than that for the SC Ap- 
proach, a difference that falls far short of significance. On the 
Reading subtest the mean for the LE Approach was also slightly 
higher (LE, 18.81; SC,17.62) and this difference, although only a 
little more than one point. Is significant at the .01 level (by ^— 
test) . 



Adjusted Means 

As a preliminary to obtaining adjusted means, the first-grade 
pretest, second-grade posttest, and the MAT third^grade April read- 
ing tests were Intercorrelated . The resulting matric^ are shown in 
Table 6.9. From these correlations, two sets of adjustments were 
obtained. One set involved adjusting the CRAFT 3 tests on the basis 
of four first-grade pretests. The other adjustments were based on 
the three Metropolitan CRAFT 2 posttests. The multiple regression 
ec[uatlons are shown in Table 6.10. The adjustment by pretests mini- 
mizes any residual effect of initial differences in readiness, and 
the resulting scores represent the cumulative effects of three years 
of learning. The adjustment by CRAFT 2 posttests partials out the 
differences in achievement present near the end of second grade, and 
therefore shows more clearly any differences in learning during the 
third grade. The two sets of adjusted scores are shown in Table 6.11. 



Adjustment bv Pretests . On Word iKnowledge, there was a very small 
difference (0.63 point) fav'^ g the LE Approach over the SC Approach. 
The standard deviations were ^.arge, almost as large as the means. On 
the Reading subtest there was a small difference favoring the LE Ap- 
proach (1.90 points). Within the SC Approach PV was higher than BR 
on Word Knowledge by 5.23 points, a substantial difference, and PV 
was also higher than BR on Reading, by 2.26 points. Within the LE 
Approach, LE-AV was ahead of LE by 2.74 points on Word Knowledge, 
while LE was ahead of LE-AV by 2.92 points on Reading. Comparing the 
four methods, PV was the highest on Word Knowledge, and BR was lowest 
while on Reading LE was highest and BR was lowest. 



Adjustment bv CRAFT 2 Posttests. On Word Knowledge the LE Approach 
was ahead of the SC Approach by 1.99 points, a difference that Is not sta- 
tistically Rignif leant at the .05 level. This is also larger than the 
raw score difference and the difference adjusted by pretests by about 
two points, indicating that the LE children made more progress dur- 
ing the third grade than the SC children in Word Knowledge. 
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On the Reading sub test there was a difference In means of 2.84 
points favoring the LE Approach over the SC Approach, a difference 
which Is significantly different at the .01 level. This Is larg^^r 
than the difference adjusted by pretests but not larger than the raw 
score difference. Thus, the two approaches were not significantly 
different on Reading either In total three-year achievement or In 
third-grade achievement . 

Within the SC Approach the PV Method was ahead of the BR Method 
on Word Knowledge by 3.61 points and on Reading by 1.47 points; for 
the former P Is less than .05 and significant (two-talled test), 
while the latter Is not significant. The difference for the post- 
test adjustment was smaller than It was on the pretest adjustment, 
for both subtests. Indicating that It took place mainly before the 
third grade . 

Within the L£ Approach, there was a difference on Word Knowledge 
of 3.38 points favoring LE-AV over LE which, however, was not signi- 
ficant. Similarly, on Reading the LE advantage of 2.19 points over 
LE-AV was not significant. The differences between the two LE meth- 
ods In third grade fall within the range of chance variations. 

Grade Equivalents 



The mean raw scores for the main CRAFT population have been 
shown In unadjusted raw scores (Table 6.8), and with two kinds of 
adjustments (Table 6.11). The grade equivalents corresponding to 
these three sets of means are shown In Table 6.12. It should be 
noted that for April the norm Is 3.7, and the New York City norms 
used are about one month more lenient than the national MAT norms. 

Looking first at the results of the total CRAFT population, 
their mean grade equivalent was 3.4 on both Word Knowledge and Read- 
ing. The average retardation of three months Is not large consid- 
ering the disadvantages affecting the educational adjustments of 
these children. Small differences of one month In the total popula- 
tion adjusted means are attributable to rounding errors. 

Looking next at the unadjusted results of the two approaches, 
the LE Approach means are one month higher than th€.' SC Approach means 
on both Word Knowledge and Reading. The advantage, ^dille slight, and 
not statistically significant. Is a reversal of the comparative 
standing at the end of the first grade. 

The adjustment by first-grade pretests did not change the mean 
grade equivalents for Word Knowledge, but Increased the LE lead on 
Reading to two months. The same Is true for the adjustment by second- 
grade posttests. The partlalllng out of reading readiness slightly 
Increased the LE lead In reading; partlalllng out differences In 
achievement at the end of second grade also slightly Increased the LE 
lead. 
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Table 6.12 



Mean Grade Equivalents for MAT Posttests (April, 1967) 
for Children with First through Thlrd*Grade Data 
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The analyses of variance shown in Table 6.31 revealed that none 
of the differences among approaches or methods was significant 
after the pretest adjustment. Therefore, one can conclude that 
for the total three-year period there were no significant differ- 
ences in reading achievement. On the third— grade posttests, the 
LE Approach had slightly higher means than the SC Approach but the 
differences were not significant for unadjusted scores or scores 
adjusted by pretests. Using the posttest adjustment the LE Method 
and Approach were significantly higher on the Reading sub test and 
the LE-AV method was significantly higher on Word Knowledge sub test. 
These results indicated faster progress by the children in the LE 
method and approach during the third grade. 

In summary, the SC methods were slightly and non-significantly 
ahead at the end of second grade, the LE children showed greater 
gains during third grade, and the three-year results are about even. 

Sex Differences 



In CRAFT 1, differences between boys and girls were small, 
inconsistent, and lacking in significance both on the pretests and 
on the posttests. On the CRAFT 2 posttests some sex differences 
began to emerge. 

Unadjusted Scores . The means have bt^n presented separately for 
boys, girls and total in Tables 6.7, 6.8, and 6.11. In the dis- 
cussion thus far only the totals have been considered. A look at 
the tables, however, discloses some large and significant sex 
differences. 

On the April unadjusted raw scores for Word Knowledge and 
Reading (Table 6.8), the two sexes had approximately equal means 
in the BR Method, but in the Other three methods girls were ahead 
by two to four points. For all methods combined girls were ahead 
by 2.26 points in Word Knowledge, and by 1.42 points in Reading; 
the former difference amounts to three months of grade score and 
the latter to one month. The largest difference between boys and 
girls was in the LE Method, with girls ahead by four points of raw 
score and four months of grade score. 

Adjusted Scores . In Tables 6.11 and 6.12 it is evident that the 
effect of the adjustments was to increase the differences favoring 
girls. The difference favoring girls over boys on the pretest adjust 
roent in the LE Method was increased to eight points of raw score and 
six months of grade score in Word Recognition, and five points and 
five months in Reading. The difference favoring girls in the LE 
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Method was almost as large in the posttest adjustment. Girls also 
surpassed boys by six months on Word Knowledge adjusted by pretests 
in the LE-AV and PV Methods. 

In Reading, the pretest adjustment gave girls a lead of five 
months in the LE Method, and the posttest adjustment gave them a 
four-month advantage. On the other hand, grade equivalents in both 
adjustments were equal for boys and girls in the BR Method. In PV, 
girls had an advantage of two months for both adjustments. In LE- 
AV the sexes had equal grade scores on the pretest adjustment but 
girls had a two-month advantage on the posttest adjustment. 

Since boys and girls were equal on the first-grade pretests 
posttests, but girls were ahead in three of the methods by the 
third grade, the differences developed during the second and' third 
grades. The fact that differences were increased by the adjustments 
indicates that girls tended more than boys to utilize their learn- 
ing aptitudes in second and third grades . 

Effect Of Kindergarten Experience 

The number and per cent of children who did and did not have 
kindergarten experience are shown in Table 6.13. The very small 
groups who had only a little kindergarten, or who had other pis— 
school experience in addition to kindergarten, have been excluded. 
Approximately three-quarters of Group I had. full kindergarten, a 
higher percentage • than for the total first-grade population. The 
percentages varied from a low of 62.9 per cent for BR girls to a 
high of 95.6 per cent for LE-AV girls. 

The findings favoring children with kindergarten experience 
over children without such experience was continued,, for the most 
part, through the third grade. When all children were compared 
iijjjespectiv© of approach or method (Table 6.14) the kindergarten 
group had slightly higher means, which, when converted into grade 
equivalent scores (Table 6.15) amounted to a superiority of one 
month on both Word Knowledge and Reading. Children in the LE Ap- 
proach with kindergarten experience also did better than the non- 
kindergarten population in the same approach. Differences here 
amounted to five months on Word Knowledge and three months on Read- 
ing, both differences being significant at the .01 level. When 
children are further compared. by method, kindergarten children in 
the BR, LE, and LE-AV Methods did better than children without kin- 
dergarten experience. For children. in the LE group the difference 
was significant on both sub tests at the .01 level. 

On the other hand, non-kindergarten children in the PV classes 
did better than the kindergarten group on both Word Knowledge and 
Reading, and these differences, while not significant, were sub- 
stantial enough to offset advantages held by BR Method kindergarten 
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children, so when comparisons are made using the total SC popula- 
tion the non-kindergarteners have higher mean and grade equivalents 
on Word Knowledge and similar scores on Reading. Thus in CRAFT 3 
we find the first evidence of non-kindergarten children doing as well, 
and occasionally better than the kindergarten group. 

Looking at the grade equivalent scores for all of the methods 
it can be noted that means and grade equivalents for the PV non- 
kindergarten group rank first on the Word Knowledge subtests, fol- 
lowed by LE and LE-AV kindergarten children, LE-AV non-kindergarten, 

BR and PV kindergarteners, BR non-kindergarten children, and finally 
LE non-kindergarteners. Similar rankings can be found for results 
on the Reading subtest, although LE children with kindergarten exper- 
ience rank ahead of PV children without such experience. 

Comparisons of scores for boys and girls are also given in Table 
6.14. For all methods combined, the boys did about equally well with 
or without kindergarten on both Word Knowledge and Reading. On the 
other hand, girls with kindergarten experience did generally better 
than girls not having this experience. 

In summary, kindergarten children in the LE classes continued 
to maintain their advantage over the non-kindergarten group, whereas 
the advantages held by the SC kindergarten children through the second 
grade were not maintained by the end of grade three. 

Early Readers 

Of the children isdio had been identified as early readers at the 
beginning of first grade, 40 were located in third-grade classes and 
were divided almost equally between the two approaches. The unad- 
justed raw score means for the two approaches are shown in Table 6.16. 
On the October MAT the two groups were approximately equal on Word 
Knowledge and the children in the SC Approach had a lead of four 
points in Reading, corresponding to three months of grade score. On 
the New York State terts, also given in October, the SC children were 
slightly ahead on both subtests and total. However, on the April MAT, 
the LE Approach means surpassed the SC Approach means by 5.57 points 
in Word Knowledge and by 3.74 points in Reading; although the ^*s are 
not significant for any of these comparisons because the number of 
cases is small, the trend was for early readers in the LE Approach to 
show accelerated gains between October and April. 

These comparisons become clearei: when expressed in terms of grade 
equivalents, as shown in Table 6.17. The New York State tests are 
omitted since they do not have grade norms. Since the October MAT was 
i'rimary II and the April MAT was Elementary, raw scores of the two 
testings are not directly comparable but grade equivalents are. 

On the October MAT the early readers in both approaches had means 
slightly above the October norm, with the grade scores of both groups 
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at 3.3 on Word Knowledge, and the SC group ahead on Reading by three 
months. On the April tests both groups had arithmetic means at the 
norm of 3.7. The SC group had means of 4.1 in both reading sub tests, 
four months abo »e the norm, and indicating gain at better than an 
average rate since the October testing. The LE group had means of 
4.7 in Word Knowledge and 4.6 in Reading, an Improvement of 1.4 years 
in Word Knowledge and 1.8 years in Reading from October. 

When the early readers are compared with the total population 
and within approaches, there are significant differences favoring 
early readers on all sub test comparisons for tests taken in October 
and April (Table 6.18) and all but one of these is significant at 
the .01 level. Scores for the MAT tests are converted into grade 
equivalents in table 6.19. The October test results indicate that 
early readers had grade scores ranging from 2.9 to 3.3, as opposed 
to 2.4 to 2.6 for the total group, an eight month advantage on Word 
Knowledge and a five month advantage on Reading. The early readers 
achieved slightly above national norms on Word ^lowledge and slightly 
below national norms on Reading. 

By April the early readers had Increased their advantage over 
the total population. This differential was most pronounced in the 
LE Approach, Where the difference favoring early readers was 1.4 
years on Word Knowledge and 1.2 years on Reading. Since the differ- 
ences between early readers and total group in the SC Approach was 
somewhat lower than that, the difference between early readers and 
■‘"he total population was similarly reduced, becoming 1.1 years on 
Word Knowledge and .8 year on Reading. 

Table 6.20 summarizes the difference between the early readers 
and the total population through the three years of the study and 
indicates that early readers not only adileved higher readiness 
scores than the total population at the start of the study but con- 
tinued to Increase that advantage through the third grade. 



4. Results for Group II 

Group II, the third graders who had been part of the experi- 
mental population in CRAFT I but transferr^ out of CRAFT schools 
at some time between the CRAFT I posttests and the CRAFT 2 posttests, 
was somewhat smaller than Group I snd included 267 children. Their 
results are shown in Tables 6.21 through 6.25. On the October reading 
tests (Table 6.21) the SC means were higher than the LE means or both 
subtests of the. MAT and both subtests of the New York State test. 
Girls had higher means than boys in both approaches and in three of 
the four methods. In LE-AV, however, the slight and non-significant 
differences were in favor of boys on the two comprehension subtests 
and in favor of girls in the two measures of word recognition. 
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The unadjusted means for the April MAT are shown in Table 6.22. 
The means for the total Group II are not significantly different from 
the corresponding means for Group I. The LE Approach was slightly 
higher on Arithmetic, while the SC Approach had slightly higher means 
on Word Knowledge and Reading. None of the differences was signifi- 
cant . 



The April MAT reading scores were adjusted by first-grade pre- 
tests and the results are shown in Table 6.23. For totaX groups, 
the SC Approach had slightly higher means than the LE Approach. 

Among the methods PV had the highest means, followed by LE-AV, BR, 
and LE. None of these differences was statistically significant. 

Girls had higher means than boys in all comparisons by method 
and approach, with the largest differences in the PV and LE-AV meth- 
ods. The 37 girls who had been in the PV Method had adjusted mean 
grade equivalents of 3.6 in Word Knowledge and 4.1 in Reading, sur- 
passing the norm by four months in Reading. For all methods com- 
bined, girls surpassed boys by 3.07 points in Word Knowledge and by 
5.66 points in Reading. The latter difference corresponds to a dif- 
ference of six months in grade score and is significant beyond the 
.001 level. The sex differences, then, were larger and more signi- 
ficant than any of the differences between approaches or methods. 

The distribution of Group II children in regard to kindergar- 
ten experience is shown in Table 6.24. For all methods combined, 
56.62 per cent of Group II had attended kindergarten. This per- 
centage is substantially lower than the 74.27 per cent for Group I. 
The percentages varied among the methods, from 67 per cent in LE 
to 51 per cent for BR, and the LE Approach had 61.59 per cent as 
compared to 51.49 per cent for the SC Approach. 

The April MAT scores for the kindergarten-no kindergarten com- 
parisons are shown in Table 6.25. All of the differences were small 
flfui in favor of those with kindergarten experience. 



5. Results for Group III 

Gfoup III contains the children located in regular third— grade 
classes who had taken CRAFT pretests in first grade but ^dio had 
transferred to other schools before the first-grade posttests. Al- 
together 237 children had left the CRAFT classes before the first- 
grade post tests, and’ 96 of them with April MAT third— grade -scores 
were located. October scores were found for 79 children. The statls 
tical details for these children are shown in Tables 6.26 through 
6.30. 

The October' test results for Group III are shown in Table 6.26. 
In comparison with Group I (Table 6.7), Group III had total means 
consistently about two months lower. Because of small numbers and 
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doubtful representativeness of the subgroups in this table, it does 
not seem desirable to make detailed subgroup comparisons. 

The unadjusted April Metropolitan results are shown In Table 6.27 
and the April results adjusted for first-grade pretests are shown in 
Table 6.28. Since the latter table shows the results when differences 
in reading readiness have been partlalled out, it Is the best basis 
for judging the third-grade achievement of Group III. ^ All third- 
grade children in Groups I, II, and III were combined in the adjust- 
ing procedure. 

Comparison of the Total means in Table 6.28 with those in Table 
6.11 shows that Group III was substantially lower than Group I on 
both MAT sub tests. The differences amount to 4.99 points in Word 
Knowledge and 3.85 points in Reading, corresponding to differences 
of three months and four months in grade scores. These differences 
are due mainly to the poor showing of Group III boys in the SC Ap- 
proach, ^o did cohslderably worse than boys in the LE Approach. 

This is not true of Group III girls . 

It may be noted that in Arithmetic, Group III did very slightly 
better than Group I, and the per cent with kindergarten experience 
in Group III (Table 6.29) was eq^ual io that for the CRAFT I popula- 
tion (Harris & Serwer, 1966 a, p. 22). Thus the poorer third-grade 
reading scores for Group III are not explainable In terms of readi- 
ness, learning ability in arithmetic, or presehool experience. 

Unadjusted means for Group III are nhown for those with and with- 
out kindergarten experience in Table 6.30, but the numbers are ao 
small and representativeness so uncertain that few conclusions can be 
drawn. The differences between the 53 children with kindergarten and 
the 36 without kindergarten were in favor of the former, but were 
small and non-significant. 

Analysis of Variance 

In an effort to determine whether statistical differences existed 
among Groups I, II, and III 'in reading achievement when the method by 
which they were taught was Isolated, analyses of variance were carried 
out and the results are summarized in Table 6.31. There were no sig- 
nificant differences betweien the amount of exposure to the CRAFT Pro- 
ject on the Word Knowledge and Reading sub tests for the BR, PV, or 
LE-AV Methods when the subtests were adjusted by the pretests. For the 
remaining method, LE,. there was a significant difference at the .01 
level, favoring Group I on Reading, and suggesting that LE children 
who remained in the CRAFT Project for the longest period of time bene- 
fitted most on aspects of reading comprehension. 

M 

Further analyses of variance were carried out to determine whether 
the approach or' method used with boys and girls had any differentiating 
effect on their achievement. These findings are also sunomarlzed in 
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Table 6.31, and Indicate that while there were differences between 
boys and girls on several sub tests, and an occasional difference 
between the approaches or methous used, there were no significant 
Interaction effects between sex and methodology. This suggests that 
children of either sex can achieve equally. Irrespective of the 
method or approach by \dilch they are taught. 



CHAPTER VII 



THE FIRST-GRADE REPLICATION 



The CRAFT plans from the beginning incorporated the hope and 
plan that it vrould be possible not only to carry the original study 
through the third grade, but also to repeat the study with experi- 
enced teachers and new children. It was believed that such a repli- 
cation study would come closer to a natural situation without the 
Hawthorne Effect (or with far less of It) and with differences in 
rate of learning a new teaching method eliminated as an Irrelevant 
variable. Although the federal contract for the continuation study 
(CRAFT 2 and CRAFT 3) did not Include funds for a replication, coop- 
erative effort by The City University of New York and the Board of 
Education of the City of New York made It possible to carry the 
Replication Study through grades one and two. The grade one proce- 
dures and results (Replication 1) are covered In this chapter; grade 
two procedures and results (Replication 2) may be found in Chapter 
VIII. 

1. First-Grade Replication Procedures 

The general aim of the Replication Study was to repeat the orig- 
inal CRAFT study with only such changes as seemed necessary or highly 
desirable. 

General Plan 



All first-grade teachers who were In CRAFT 1 were invited to 
take part In the Replication Study (except those In School F idiich 
did not participate In CRAFT 2). Thirty of the original 48 teachers 
took part In 1965-66. Of these, 26 repeated the same four teaching 
methods they had used In 1964-65. In addition, a fifth method, a 
combination of LE-AV and FV, was developed and called the "Pilot 
Method." It was used by four teachers in two schools, all of whom 
had used either LE-AV or PV in CRAFT 1. The majority of the 18 
teachers tdio did not take part In the replication study left for 
reasons other than the teaching situation (maternity, leaving the 
city, promotion tp a supervisory position) while a minority expressed 
dissatisfaction either with the method they had used, or with the 
experimental constraints. 

The distribution of classes in the five methods among the 11 
schools is shown In Table 7.1. The Pilot Method operated in four 
classes in Schools A and B. In nine of the other ten schools there 
were both SC and LE Approach classes; the tenth (School I) had only 
two BR classes. The symmetry of the original CRAFT 1 design was 
absent, but In most schools a comparison could be made between the 
two approaches . 
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After a two-week readiness period, pretests were administered. 
Instruction in reading began the day after corapletion of the pre- 
tests, and continued for 140 school days. Then posttests were ad- 
ministered. Similarities and differences between the original and 
replication studies together with elements pertaining to the Pilot 
Method are given below. 

Teaching Methods 

The Pilot Method involved spending 20 to 30 minutes a day 
teaching word recognition according to the Phonovisual manual. The 
rest of the 180 minutes per day were to be used as in the LE-AV 
Method. The BR, PV, LE, and LE-AV Methods were taught as in the 
original project. 

Instruments 



There had been so much criticism of the original pretest bat- 
tery by the CRAFT teachers as eidiausting and frustrating that a 
shorter pretest program was used, consisting of four sub tests of 
the Metropolitan Readiness Test. All children also took, at pre- 
test time, a short word recognition test devised for use in this 
project, called the CRAFT Word Recognition Test (see Appendix). 
Additional experimental tests (The Macmillan Reading Readiness rest 
and a Visual-Motor Test) were given to a sampling of the chilaren 
to collect standardization data. 

Posttests were essentially the same as in the original study. 
The Stanford Primary I Battery, Form X, was administered to all 
children. The San Diego Pupil Attitude Inventory was also adminis- 
tered to all. A randomly selected subsample of two boys and two 
girls per class were given the Gilmore Oral Reading Test, the Gates 
Word Pronunciation Test, and the Fry Test of Phoneticallv Regular 
Words. Written compositions were obtained from all chl^ ren using 
the same procedures as in CRAFT 1 and were scored for the indivi- 
dually tested subsample. 

The Daily Log Form (1230 edition, the same as in CRAFT 2) was 
filled out for five consecutive teaching days for five months. The 
teachers also filled out the San Diego Teacher Attitude Scale after 
the children took the post tests (they had taken this twice before, 
at the beginning and end of CRAFT 1) . The OScAR R was not used in 
Replication 1 since research assistant time for classroom observa- 
tions was not available. 

Supervision and Experimental Controls 

Although the major part of the supervision provided by the 
assistant director and consultants during 1965-66 was devoted to the 
CRAFT 2 teachers, a less intensive program was carried out simulta- 
neously for the Replication 1 teachers. The number of after-school 
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workshop sessions was halved, and nearly all of the sessions were 
held on a district basis rather than centrally. The Replication 1 
teachers were visited less often, and made requests for help far 
less frequently than they had the previous year. In consequence 
of the reduced amount of after-school activity ■•required, the stipend 
for the Replication teachers was reduced to $100. 

Since the Replication 1 teachers retained the reading materials 
(and the LE-AV teachers, the equipment) supplied during CRAFT 1, 
problems of lack of materials or delayed deliveries were far less 
frequent than in the first year. On the whole, the morale of the 
Replication 1 teachers seemed better than it had been during the 

original study. 

The Daily Logs provided a check on use of time, and provided 
scores differentiating the teaching methods. The San Diego Teacher 
Attitude Inventory also provided information on differentiation of 
the teaching methods. 

g]»Qup pretests and posttests were administered by the Cor** 
rective Reading teacher of the school. The individual tests were 
administered by the district reading consultant. All tests were 
hand-scored by the central research staff. The Log forms were aver- 
aged as in CRAFT 2, using an IBM 1230 Visual Scanner to get data 

cards . 

Statistical Treatment 

The statistical treatment was modeled very closely after that 
of CRAFT 2. Means were first computed for the five methods on the 
Metropolitan Readiness subtests. By inspection the differences 
seemed large enough to make it advisable to adjust the posttests to 
minimize the effects of initial differences in readiness. 

A correlation matrix of 17 variables was computed, including 
pretests and posttests. The four Metropolitan subtests and the num- 
ber of full days of kindergarten had significant r*s with the Stan- 
ford posttests and were selected as predictor variables. Using 
these five variables, a multiple regression equation was obtained 
separately for each of the Stanford sub tests and also for each of 
the individual measures obtained for the subsample. For each post- 
test a predicted score was obtained for each pupil, and from these 
a predicted mean was obtained for the class. The disparity between 
the predicted mean and the obtained mean was used to find the ad- 
justed class mean. Thus, if the obtained class mean was 22.0 and 
the predicted mean was 21.0, the difference of 1.0 was added to the 
obtained mean to get an adjusted mean of 23.0. When the predicted 
mean was higher than the obtained mean, the adjusted mean was low- 
ered; when the predicted mean was lower than the obtained mean, the 
adjusted mean was raised. 
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The adjusted class means were combined to get means by method 
and approach; these were then tested for significant differences 
using analysis of variance and, where indicated, jt tests. 

Two Intercorrelation matrices were then computed, including the 
adjusted posttests, the pretests, and all other variables that seemed 
relevant. The first matrix, involving 40 variables. Included only 
the three main Log categories. The second, with 23 variables, in- 
cluded all Log variables and posttests. These matrices were 

Inspected for significant £*s with the posttests, and variables with 
such jr's were selected for additional analyses. 

The Teachers 



All but two of the 30 teachers were regularly appointed; two LE 
teachers were "permanent substitutes." Educational level, shown in 
Table 7. 2, was reasonably well balanced between the two approaches and 
among the four methods. In age (Table 7.3) the LE-AV teachers were 
the oldest, with the Pilot teachers next; the range within each method 
was at least 24 years. Similarly, the LE-AV teachers had most years 
of teaching experience, with the Pilot teachers next (Table 7.4). The 
LE-AV group also had the highest mean and median for years of first- 
grade experience, with the other four groups fairly well balanced 
(Table 7.5). 



2. Pretest and Posttest Results 



Pretest Results 



The means and standard deviations on four subtests of the Metro- 
politan Readiness Tests of the children in the two approaches and 
five methods are shown in Table 7.6. Children who transferred out 
before the posttests were given are not Included in this or subse- 
quent tables in this chapter. By Inspection the differences on the 
various sub tests were large enough to make it desirable to control 
pretest differences by an adjusting procedure. The SC Approach had 
higher means on Word Meaning and Matching; the LE Approach had higher 
means on Listening and Alphabet. The BR Method had the highest mean 
on Word Meaning and Listening; the Pilot Method had the highest mean 
on Matching and Alphabet. 

The Replication 1 population could be compared with the CRAFT 1 
population on two of the four subtests (Table 7.7). On both, the 
Replication means were higher: on Word Meaning, Original mean 5.25; 

Replication, 6.04; on Listening, Original, 6.79; Replication, 8.49. 

The Replication means were also closer to the mean for the 
normative population on both sub tests. However, as compared to the 
normative population the Replication population was below average on 
all four subtests, with approximate percentiles of the means as fol> 
lows: Word Meaning, 20th; Listening, 44th; Matching, 27th; and 

Alphabet, 32nd. 
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The fou*’ Metropolitan subtests, three measures of preschool 
attendance, and ten posttest measures were correlated In a 17 x 17 
matrix (Table 7.8). Most of the ^*s with the Stanford posttests 
were In the .30*s and .40's. Of the four pretests, the Alphabet 
subtest had the highest correlations both with the Stanford sub- 
tests and with the Individually administered oral reading tests. 

Of the three measures of preschool attendance only Number of 
Full Days In Kindergarten had statistically significant correla- 
tions with the posttests, and those were very low. The other two 
measures had zero values for most of the children and this may have 
been the reason for their non-slgnlf leant with posttests. 

Correlations with the Individual oral reading tests, given to 
a subsample of four dilldren per class, were about equal to those 
with the Stanford for the Alphabet sub test, but were very low for 
the other three readiness sub tests. The _r*s were lowest with the 
Fry Test of Phonetically Regular Words and highest with Gilmore 
Accuracy . 

Correlations of pretests with the San Diego Pupil Attitude 
Inventory, a posttest measure of Interest In reading, were signi- 
ficant but quite low. In the .20's. 

Posttest Results for the Total Population 

The unadjusted raw score means for the Stanford posttests are 
shown In Table 7.9; these means are based on pupils, not classes. 

The means for the four original methods and the two approaches are 
quite close together on the five subtests; the means for the Pilot 
Method are highest on the three reading sub tests (Word Reading, 
Paragraph Meaning, Word Study Skills) and Spelling, and about equal 
to the others on Vocabulary (oral vocabulary) . The corresponding 
means using the class as unit are very similar (Table 7.10). 

Multiple regression equations were computed using the four 
Metropolitan Readiness subtests and Full Days of Kindergarten as 
predictor variables; the equations are shown In Table 7.11. The 
Metropolitan subtests all had significant weightings, but kindergar- 
ten attendance had zero weight. Apparently any beneficial effect of 
kindergarten was Incorporated In the pretest scores, and when those 
were partlalled out there was no residual kindergarten effect. 

The adjusted results for the Stanford subtests, computed from 
the scores of the Individual pupils, are shown In Table 7.12. For 
the four original methods the changes were small; BR means were 
lowered slightly on four tests, PV means rose on all five tests. LE 
means were lowered on four tests, LE-AV means were raised on all 
four subtests. The Pilot Method Improved substantially on all sub- 
tests except Vocabulary, Increasing the differences between the 
Pilot Method and the four original methods. 
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To correspond with the statistical procedure of the original 
CRAFT study, adjusted means for methods and approaches were also 
computed using the class as the unit. After a predicted score was 
obtained from the multiple regression equation, a mean of predicted 
scores was obtained for each class. The difference between obtained 
mean and predicted mean was used to adjust the obtained means. This 
procedure was followed for each Stanford subtest and also for the 
tests given to the subsample of four children per class. 

liie adjusted Stanford means based on che class as the unit are 
shown In Table 7.13. The differences from the means utilizing the 
pupil as the unit (Table 7.12) are very small. In most cases less 
than one-fifth of a point. 

An analysis of variance was computed for each adjusted Stanford 
sub test for the two approaches; one of these for Paragraph Meaning 
Is shown In Table 7.14. None of these analyses disclosed a differ- 
ence significant at the .05 level. There were, then, no significant 
differences between the SC Approach and the LE Approach on the ad- 
justed Stanford subtests. 

An aiialysls of variance was also computed for each adjusted 
Stanford subtest for the five methods. Four of these analyses did 
not show significant treatment differences, but the fifth, for Word 
Study Skills (Table 7.15), disclosed a difference significant beyond 
the .01 level. This was obviously due to the considerably higher mean 
for the Pilot Method on this subtest. In Word Reading, Paragraph Mean- 
ing, and Spelling, the advantage of the Pilot Method was not large 
enough to show a significant difference In the analysis of variance. 

The grade equivalents corresponding to the adjusted means for the 
five methods are shown In Table 7.16. The differences In grade scores 
are much smaller than the differences In adjusted raw score, shown In 
Table 7.13, due to the fact that one month of grade score usually covers 
three adjacent raw scores In the norms for this test. The Pilot Method 
had means of 1.8 In Spelling and Word Study Skills (equal to the norm) 
and 1.7 In Word Reading, being the highest on those three subtests. On 
Paragraph Meaning the LE and Pilot Methods were similar at 1.6, just one 
tenth of a grade ahead of the other three methods. On Vocabulary the 
PV and LE-AV Methods were equal at 1.5 and the other three methods were 
one- tenth lower. 



Comparison of Original and Replication First Grade Results 

The main reason for conducting the Replication Study was to attempt 
to eliminate, or diminish as much as possible, two possible sources of 
€irror. The first was Hawthorne Effect, the generally facilitating Influ- 
ence of knowing that one Is taking part In something new and experi- 
mental and that results are to be carefully measured. It was expected 
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that Hawthorne Effect, if present during the original study, would 
wear off by the end of the first year or early in the replication 
year. The second was rate of learning to teach by a new method. 

It was hypothesized that the LE Approach was learned more slowly 
than the SC Approach and that the LE results might show a differen- 
tial gain during replication. 

The Replication 1 means are compared with the CRAFT 1 means in 
Tables 7.17 to 7.21 based on adjusted class means. On Word Reading 
(Table 7.17) the LE and Pilot Methods gained, LE-AV remained approxi- 
mately the same, and PV and BR lost. Analysis of variance reveals a 
difference between Pilot and other methods significant at the .05 
level, but no significant difference between the two years.* On 
Paragraph Meaning (Table 7.18) the LE and LE-AV Methods gained 
slightly and the other three methods lost slightly, but none of the 
differences was significant. On Vocabulary (Table 7.19) the five 
methods had very similar means in both years and none of the differ- 
ences were significant. On Spelling (Table 7.20) the Pilot teachers 
had a substantial lead over the other four methods, significant at 
the .01 level. However, they had an even greater lead in CRAFT 1 
than in Replication 1, and their Replication 1 mean was lower than 
their mean the year before. In Spelling the LE, LE-AV, BR, and 
Pilot Methods all had lower means during the second year, and only 
PV had a slight gain; differences between the two years were not sig- 
nificant. Word Study Skills (Table 7.21) was the only sub test which 
showed both a significant difference between the Pilot Method and the 
other methods, and also a significant change from first year to sec- 
ond, with PV and Pilot gaining about three points each, and BR losing 
nearly eight points. 

To summarize the above findings, the Pilot Method was signifi- 
cantly superior to the other four methods on Word Reading, Spelling, 
and Word Study Skills. However, the Pilot teachers had been either 
PV or LE-AV teachers in CRAFT 1, and only in Word Study Skills did 
they show a significant gain using the Pilot Method as compared to 
their original method. When their adjusted grade score means are 
compared for the two years (Table 7.22) it is evident that they did 
equally well both years in Paragraph Meaning, did slightly better 
the first year in Vocabulary and Spelling, and did better the second 
year only in Word Reading and Word Study Skills. The generally 
superior results of the Pilot Method, then, seem to be due more to 
being taught by above-average teachers than to the method Itself, 
although there was some improvement in word recognition skills. The 
results of the second year of the Replication Study will help to 
determine how general and how lasting the good effects of the Pilot 
Method were. 



*The Pilot teachers had taught PV or LE-AV In CRAFT 1; all other 
teachers taught the same method both years. 
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Results of the San Diego Pupil Inventory 



On the San Diego Inventory of Pupil Attitude the means for the 
approaches and methods all fell within a very narrow range, 18.35 
to 19.09 (Table 7.23). Even when computed with the child as a unit, 
the largest difference (between LE and BR) Is not significant. 

In CRAFT 1 the SD Pupil Inventory means were as follows: BR, 

17.20; PV, 14.98; LE, 15.87; LE-AV, 15.58. The differences between 
BR and the other three methods were significant. 

It Is evident, therefore, that SD Pupil Inventory scores were 
higher In all four methods In Replication 1 than In CRAFT 1, and that 
there was no significant difference among methods or between ap- 
proaches In Replication 1. 

Subsample Results 

The subsample of four children per class was checked for repre- 
sentativeness by comparing subsample means with class means on the 
Stanford Paragraph Meaning test. In the 30 classes, 19 differences 
favored the class mean and 11 favored the subsample mean, well within 
the range of chance fluctuations from a 15-15 split (Chi-Square Test) . 
In none of the 30 classes was the difference between subsample mean 
and class mean significant at the .05 level (t-tests). The subsample, 
therefore. Is a reasonably representative sample of the Replication 1 
population. 

The subsample results for the Individually administered oral 
reading tests are shown In Table 7.24. The Gilmore Oral Reading Test 
provided two scores, a grade equivalent for Accuracy and a raw score 
for Rate. Of the two. Accuracy Is the more Important, as Rate Is of 
little consequence In first grade. On Gilmore Accuracy the Pilot 
Method was highest and above the grade equivalent norm at 2.16, the 
Skllls-Centered Approach was approximately at the norm of 1.8 with 
a mean of 1.75, and the LE Approach was lowest with a mean of 1.45. 
Differences between methods within each approach were very small. 

On Rate the two Skllls-Centered methods were substantially ahead of 
the other three methods. 

On the Gates Graded Word Pronunciation Test, a list selected on 
the basis of word frequency, the Pilot Method was far ahead of the 
other methods with a mean of 11.56; second was BR with 8.08, followed 
by PV, LE, and LE-AV. 

On the Fry Test of Phonetically Regular Words there was an even 
greater difference; the Pilot mean of 12.75 was far ahead of the 
other methods, all of which had means below 1.0. 

When these means were adjusted, the only pretest that had suf- 
ficient correlations with the Individual posttests to warrant 
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partlalllng It out was the Metropolitan Alphabet subtest, and that 
was the only predictor used. The adjusted means are shown In Table 
7.25. The general effect of the adjustments was to Increase the dif- 
ferences noted among the unadjusted means. The Pilot means were 
raised substantially on Gilmore Accuracy, Fry, and Gates, and lowered 
slightly on Gilmore Rate. The BR means were raised slightly on 
Gilmore Accuracy and Gates, raised substantially on Gilmore Rate, and 
lowered slightly on Fry. Tl LE and LE-AV means were lowered on all 
four measures. However, nearly all the S.D.'s were greatly Increased, 
so that the relative differences were not changed very much. 

The effect of the adjustments, then, was to confirm the Pilot 
Method's lead over the other four methods on Gilmore Accuracy, Fr-r, 
and Gates, reinforcing the Impression that this method was outstand- 
ing In Replication 1 In developing word recognition and oral reading 
skills. The SC Approach pupils achieved at grade level on these 
tests, while the children In the LE Approach did quite poorly on 
them. The greatest superiority of the Pilot Method was on the Fry 
Test on which both PV and Pilot Methods should have shown to advan- 
tage. However, the regular PV classes did no better than the BR 
and LE-AV classes. Despite evidence above that the Pilot teachers 
had been superior teachers In CRAFT 1 as well as In Replication 1, 
the outstanding results of the Pilot Method on the subsample mea- 
sures do not seem to be explainable entirely on the basis of teacher 
superiority . 

Unadjusted results for three measures based on the Writing Sam- 
ple are shown In Table 7.26. On the number of running words, a mea- 
sure of composition length. Pilot was highest, followed by BR, PV, 
LE-AV and LE In that order. The same rank order held true on number 
of words spelled correctly. On Mechanics Ratio, a measure of cor- 
rectness of usage and punctuation, all means fell within a very nar- 
row range. 



3. Teacher Variables 



Teacher Logs 

It was not possible to make as thorough an analysis of the Dally 
Log data In Replication 1 as had been done In CRAFT 1 and 2. 

An In ter correlation matrix of 40 x 40 variables was computed, 
which Included the adjusted class means oh the posttests. This matrix 
is shown In Table 7.27. Four Dally Log variables were Included In 
that table and are numbered 36 to 39. The posttest variables are 
numbered 23 to 32. 

The LE vs SC Approach scale measures the degree of agreement 
with one or the other of the two approaches. The only significant r_ 
between this scale and posttests Is with Gilmore Rate, -.44. 
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time for all activities had non-significant ^*s with all posttests 
except Gilmore Accuracy and Rate, for which the £'s are low and nega- 
tive. Reading Activities Time has no significant jr's with posttests. 
Supportive Activities Time has negative r_*s with Stanford Spelling 
and with Gilmore Accuracy and Rate; the jr's are significant. Be- 
cause of the small number of teachers in each method, ^'s for che 
separate methods were not computed. 

The means for Reading Time, Supportive Time, and Total Time are 
given in Table 7.28. The SC teachers devoted more time to Reading 
than to Supportive Activities. BR teachers spent a little more time 
on Reading and less on Supportive than FV teachers. In contrast, the 
LE Approach teachers again spent substantially more time on Support- 
ive than on Reading Activities. This was particularly true of the 
LE-AV teachers, xdio spent only 66.8 minutes per day on Reading as com- 
pared to 101.2 minutes on Supportive. Although the ^'s with Reading 
Time are not significant, it may not be a coincidence that the LE-AV 
Method had the lowest achievement, and also spent least time on Read- 
ing Activities. 

The in ter correlations of 20 Log variables with adjusted Stanford 
class means on Word Meaning, Paragraph Meaning, and Word Study Skills 
are shown in Table 7.29. It should be noted that results of the Log 
analysis in CRAFT 1 had been discussed with the teachers at the first 
workshop meeting in Replication 1, and individual teachers probably 
made some changes in their use of time. 

In general, there is a notable lack of correlation between Dally 
Log variables and reading. None of the r.'s with Word Reading or with 
Paragraph Meaning is significantly greater than zero. For Word Study 
Skills there is a negative ^ of -.41 with Experience Chart Time, a 
negative i of -.59 for Art Work with Reading, and a plus .42 with 
Phonic Activities. 

Since these ^'s are based on the total g^roups of classes includ- 
ing all methods, some jr's might have been significant within a 

particular method may have been cancelled out by putting contrasting 
methods together. 

San Diego Teacher Inventory 

The Replication 1 teachers filled out the San Diego Teacher 
Inventory three times: at the beginning of CRAFT 1, at the end of 
CRAFT 1, and at the end of Replication 1. At the beginning of CRAFT 1 
the teachers in all methods showed a slight preference for the Basal 
scale and differences among the four methods were not significant. By 
the end of CRAFT 1 the BR and FV teachers scored higher on the Basic 
scale and lower on the Individualized and Language-Experience scales, 
while the LE and LE-AV teachers scored lower on the Basal scale and 
substantially higher on the Individualized and Language-Experience 
scales . 
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By the end of Replication 1, this trend was even more marked 
(Table 7 . 30) . Of 18 comparisons within the originail four methods 
16 showed differences of significant size. The BR and PV Groups 
showed strong agreement with the Basal scale, moderate disagreement 
with the Individualized scale, and strong disagreement with the 
Language-Experience scale. The LE and LE-AV groups showed strong 
agreement with the Language-Experience scale, agreement with the 
Individualized scale and slight disagreement with the Basic scale. 
Differences within each approach were small and not significant. 

Very interestingly, the Pilot group, idiose method was a com- 
bination of Language Experience, Audio-Visual, and Fhonovlsual fea- 
tures, gave San Diego responses typical of the teachers in the LE 
Approach. They scored even higher than LE and LE-AV on the Language- 
Experience scale, and their means on the other two scales were very 
close to the LE and LE-AV means. 

Teacher Competence Rating 

The rating of teacher competence had jr's with the post tests 
that were generally positive but quite low. Four of the how- 
ever, are significantly greater than zero for Stanford Word Reading 
and Word Study Skills, Gates, and Fry. Thus there are significant 
£*s with the teacher's results in developing word recognition skills, 
but not with comprehension or oral reading of meaningful material. 

It is not surprising, therefore, to find that the mean competence 
rating (Table 7.31) was highest for the Pilot teachers. 

Other Teacher Variables 



Several other teacher variables are Included in Table 7.27. 
Teacher age has no significant ^'s with post tests. The same is true 
of total number of years of teaching experience and years of first- 
grade experience. Teacher absence also had no significant £'s with 
posttests. Class size had one significant -.43 with Stanford 
Vocabulary, which is not a reading test. 



4. Other Variables 



Community Variables 

Two measures based on census tract data were Included in Table 
7.27: Median Years of Adult Education, and Median Income. Since 

these measures were based on the school's neighborhood they were the 
same for all classes in a particular school. This should decrease 
the chances of obtaining significant rjs. Nevertheless, Median Edu- 
cation shows significant r^s with Word Study Skills, Gilmore Accu- 
racy, Gates, and Fry, but not with Paragraph Meaning. Median Income 
is correlated .42 with Gilmore Rate, but has no other significant ^'s 
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In view of the positive r,'s between neighborhood education and 
posttests, it was a fully justified precaution to have both a Skills- 
Centered Method and a Language-Experience Method in each school as 
originally planned in CRAFT 1. 

Pupil Variables 

A number of pupil variables may be found in Table 7.27. The 
four Metropolitan Readiness sub tests had been partlalled out, so 
they should show non-slgnlf leant jr's with adjusted posttest means. 
This is generally true, since only five of 40 jc*s are significant. 

The child's chronological age has positive ^'s with Stanford Word 
Reading, Vocabulary, and Word Study Skills; this is probably an arti- 
fact of the adjusting process. It is interesting that with differ- 
ences in readiness partlalled out, age emerges as a significant 
variable. Fortunately there were no significant age differences 
among the method groups. 

As expected, the amount of pre-first-grade school experience 
had no significant jr's with adjusted posttests. The adjustment pro- 
cess equates the children for readiness, and any benefits from pre- 
school experience seem to be shown in large measure in higher readi- 
ness scores. 

The CRAFT Word Recognition Test was a short, 10-item test that 
was used in place of the Detroit Word Recognition Test to locate 
early readers in Replication 1. The results showed this to have been 
a mistake, as the test had poor relir'dlity and did not have a signi- 
ficant X saiy of the reading posttests. It has not been possible 

to do a study of early readers in Replication 1 because the test that 
was to be used in identifying them proved to be inadequate. 

A final pupil variable is Pupil Absence. Absence rates were 
generally low and very much alike for the five methods. While nine 
of the 10 ^'s with posttests are negative, they are all very low and 
non-significant . 
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CHAPTER VIII 



THE second-k;rade replication 



During 1966-67, while the third grade follow-up data were being 
collected, the Replication 1 children were taught by second-grade 
teachers who had been In CRAFT 2 the preceding year. The plan was 
to stay as close to the CRAFT 2 procedures as possible. 



1. Replication 2 Procedures 



The Schools 



The schools were the same as In Replication 1 except that 
School D dropped out, leaving 10 of the original 12 CRAFT 1 schools. 
The distribution of classes by method In Replication 2 Is shown In 
Table 8.1. In comparison to the 30 classes In Replication 1, there 
were 25 classes In Replication 2, divided among the methods as fol- 
lows: BR, 6; PV, 5; LE, 5; LE-AV, 5; Pilot, 4. The Pilot Method 

operated In two schools as In Replication 1. In seven of the eight 
remaining schools there was at least one SC class and one LE class. 

The Pupils 

By the time the Replication 2 posttests were given In April, 
the mean class size was 27 pupils In the entire project and In each 
of the four methods. However, additional pupils had left during the 
year since the Replication 1 posttests. They had been replaced by 
children transferring Into the school, and by a few children who were 
repeating the grade. The distribution of Replication children (the 
experimental population, who were In project classes taught by a 
specific method from first-grade pretests through second-grade post- 
tests), children who entered project classes at some time after the 
first-grade pretests, and holdovers. Is shown In Table 8.2. 

For the entire project population of 695 children there were 
405 Replication children. These comprised 58.3 per cent of the sec- 
ond-grade children. The per cent of Replication children was fairly 
even in the FV, LE, LE-AV, and Pilot Methods, ranging between 61.4 
and 67.9 per cent. In BR, however, only 43.8 per cent of the final 
second-grade pupils were Replication children. 

r 

The distribution of Replication and non-Replication children by 
method and school is shown in Table 8.3. The mean number of Replica- 
tion children per class was only 12.3 in the BR Method, while the 
other methods had means between 16.8 and 18.0. 
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The Teachers 



The 38 second-grade teachers in CRAFT 2 were invited to con- 
tinue, if possible, in Replication 2. However, there were only 30 

first-grade classes in Replication 1, and these diminished to 25 

second-grade classes in Replication 2. School D withdrew from the 
study at the close of the 1965-66 year, and in other schools the 
pupil attrition in a particular method necessitated the consolida- 
tion of two classes into one. In the Pilot Method there were enough 
pupils to maintain four classes, but only three second-grade teachers 
were available who had taught by the PV or LE— AV Method in CRAFT- 
A teacher who had taught the Pilot Method in Replication 1 volun- 
teered to teach by the same method in Replication 2. This was, then, 

her third year in the project: CRAFT 1, Replication 1, and Replica- 

tion 2. Twenty-one of the other 24 teachers were repeating the 
method they had used In CRAFT 2 . The class taught by the fomer first- 
grade teacher is included in all of the analyses belw except *e cot 
parisons oi’ Replication 2 with CRAFT 2 results, xn which her class had 
to be omitted because she had not taught in CRAFT 2. 



Means and S.D.’s for such teacher characteristics as age, total 
years of experience, and years of experience in second grade, are 
included in Table 8.4. None of these characteristics was signifi- 
cantly correlated with achievement in Replication 2. 



The Instruments 



A city-wide testing with the MAT Primary I Word Knowledge and 
Reading sub tests took place in October, 1966, under the usual con- 
ditions of administration by the classroom teachers. Scores for th s 
testing were obtained and results may be found in the tables of means 

and r*s. 



In April, 1967, the Metropolitan Advanced Primary, Form A, was 
administered. The sub tests on Word Knowledge and Reading were used 
on a city-wide basis with separate answer sheets which were scored 
by Harcourt, Brace and World Co. The subtests on Word Discr^iaation, 
Spelling and Arithmetic were also given (in a hand-scored edition) 
during the same week in Replication 2 classes, and were subsequently 
scored by research assistants. The San Diego Pupil Inventory was^ 
administered during the same week in the Replication 2 classes. A 
Writing Sample was also collected in Replication 2 classes, 
administration in Replication 2 classes was conducted by the correc 
tive reading teacher in the school, with the teacher helping as a 



proctor. 



During the same week in April a subsample 
class was tested individually with the Gilmore 
the Gates Word Pronunciation, and the Fry Test 



of four children per 
Oral Reading Test, 
of Phonetically 
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Regular Words. These tests were administered, as before, by the 
district reading consultant. 

All children \dio were in the Replication 2 classes took the 
MAT tests. The analyses below, however, are based on the Repli- 
cation children, those who were taught in CRAFT classes in first 
and second grades and for whom scores were available on first-grade 
pretests, first-grade posttests, and second-grade MAT posttests. 

Additional measures on the pupils included amount of indepen- 
dent reading, recorded by the teachers as in CRAFT 2, ratings of 
eagerness to read and maturity of choices, and pupil absence. 

The teachers, who had filled out the San Diego Teacher Atti- 
tude Scale at the beginning and end of the year in CRAFT 2, took 
this questionnaire once more after the Replication 2 post tests were 
completed. At about the same time they filled out a scale entitled 
Attitude Toward CRAFT Method which provided a measure of degree of 
satisfaction with the method used by the teacher in Replication 2. 

The teachers also filled out Dally Logs as in CRAFT 2. 

Teaching Methods 

The four original CRAFT Methods were taught as in CRAFT 2. 

The four Pilot teachers (three from CRAFT 2, one from Replication 1) 
had to develop the combination of second-grade PV and LE-AV proce- 
dures during Replication 2. 

Supervision and Experimental Controls 

The amount of time given by the consultants during Replication 2 
was reduced from \diat it had been in CRAFT 2, and corresponded more 
closely to Replication 1. The number of workshop sessions was re- 
duced and all (except one at the beginning of the year, and one in 
June that was more of a social function) were held locally by dis- 
tricts. The director and assistant director met with the consultants 
monthly. The assistant director visited all of the classes. In ad- 
dition, each reading consultant visited the classes in her district. 
Class visits were followed by discussions in \dilch suggestions for 
the Improvement of teaching were made. As in Replication 1, the 
stipend for Replication 2 teachers was $100. 

The project was unusually fortunate in that all four of the 
reading consultants who started with CRAFT in June, 1964, continued 
through January, 1967, which Included five of the seven instructional 
months in Replication 2. Two of them took leaves of absence during 
the semester beginning February, 1967. One was replaced by a new 
reading consultant who was trained in the project’s methodology by 
her predecessor, and the other was replaced temporarily by an early 
childhood consultant who had been with CRAFT since the beginning and 
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was very well versed in the methodology* In the opinion of the pro- 
ject staff this change of consultant personnel, which took place two 
months before the final achievement tests were given, did not materi- 
ally affect the results. 

The audio-visual consultant who had been assigned to the CKAFT 
Project shortly before the CRAFT 2 posttests, was authorized to con- 
tinue through the Replication 2 year, so that the LE-AV and Pilot 
teachers had the benefit of continuing AV consultant service* 

The Replication 2 teachers were able to retain the materials 
and equipment supplied to them during the CRAFT 2 year; only work- 
books needed to be replaced. Complaints of missing materials or 
equipment were far less frequent than In CRAFT 2, and teacher morale 
seemed higher. 

Adherence to assigned method was checked by analysis of the 
Daily Logs, the San Diego Teacher Attitude Inventory, and the class- 
room visits by the assistant director and consultants. 

Statistical Treatment 

The statistical treatment was similar in general design to the 
Replication 1 and CRAFT 2 procedures. An intercorrelation matrix 
based on Individual pupil scores was computed for a total of 41 first 
grade and second-grade variables. The four Metropolitan Readiness 
sub tests were used as predictor variables In multiple regression, . 
equations used to adjust the second-grade MAT sub tests by pretests* 
The five first-grade Stanford scores were used to adjust the secoiid- 
grade MAT sub tests by post tests. !^e subsample measures were ad- 
justed only when the £*s in the 41 x 41 matrix were large enough. 

Thus Gilmore Accuracy and the Writing Sample measures were not ad- 
justed, while Gilmore Rate, Gates, and Fry were adjusted by pretests. 

Class means and S.D.'s for approaches and methods were obtained 
for raw scores and adjusted scores, using the class as unit. Grade 
equivalents for the raw and adjust^ means were also obtained. 

A final intercorrelation matrix of 60 x 60 variables was then 
computed from which the r*s of the eight adjusted posttest class 
means with each of the other 52 variables were obtained. Means and 
S.D.'s were obtained by method for each of the variables in that 
matrix. The means and ^'s for the 60 variables were Inspected for 
variables other than teaching method that may have Influenced the 
results. 

2. Replication 2 Results for the Total Population 
Pretest Results 



Since the number of classes was smaller by five than in Replica- 
tion 1, means were computed for the first-grade pretests and are 
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shown in Table 8.5. These means differ from those computed in Repli- 
cation 1 not only in number of classes, but also in the loss of a 
substantial number of children. The majority of the means are 
slightly higher than the corresponding means in Replication 1, but 
the differences are- very small, and on the Alphabet subtest, which 
had the highest with post tests, the mean for all methods combined 
was slightly lower in Replication 2 than in Replication 1. The final 
Replication 2 population did not differ significantly from the final 
Replication 1 population on any of the first-grade pretests or post- 
tests. 

The first-grade posttest results for the final Replication 2 
population are shown in Table 8.6. While there are minor differences 
from the means reported in Chapter III, the basic trends are similar. 
The main differences are in the Pilot means, which are somewhat 
higher, suggesting that there was a greater tendency for inferior 
readers to leave those classes during second grade than in the orig- 
inal four methods. The differences among methods in Table 8.6 are 
sufficient to justify partialllng out first-grade posttests in order 
to emphasize the results of second-grade instruction. 

Unadjusted post test Results 

The unadjusted raw score means on the MAT posttests are shown 
in Table 8.7. The SC Approach had higher means than the LE Approach 
in all five sub tests. The Pilot Method had higher means than both 
approaches in all five sub tests. Within the SC Approach, BR was 
ah^ad of PV on Reading, Word Knowledge, and Arithmetic, while PV was 
ahead of BR on Word Discrimination and Spelling. Within the LE Ap- 
proach, LE was ahead of LE-AV on all five subtests. 



Adjusted Results 

The 41 X 41 intercorrelation matrix is shown in Table 8.8. Since 
this is based on the scores of 405 pupils, some very low this 

table are significantly greater than zero, but many of the signifi- 
cant r*s are not high enough to be of much use for prediction pur- 
poses. In this table the second-grade tests are numbered 26 to 
41. The r^*s between the four Metropolitan Readiness subtests and 
the MAT posttests (variables 28-31) seemed to justify using the pre- 
tests as predictors. There were no \r*s high enough to justify ad- 
justing Gilmore Accuracy, the San Diego Pupil Inventory, or the Writ- 
ing Sample measures. Metropolitan Matching and Alphabet subtests 
were used for adjusting the Gates and Fry scores, and Alphabet alone 
for Gilmore Rate. Multiple regression equations for the MAT post- 
tests predicted by the pretests and first-grade posttests for the 
total population are shown in Tables 8.9 and 8.10 respectively. 

The differences between approaches and methods which are reported 
in the next few pages have been checked for statistical significance 
by analysis of variance with generally non-significant results. De- 
are given in a separate section below. Thus, in pointing out a 
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difference between approaches or methods » the comment is restricted 
to a result of the present study and does not imply that a differ- 
ence in the same direction could confidently be escpected if the 
study were to be repeated. 

The means of the MAT sub tests adjusted on the basis of the 
first-grade Metropolitan Readiness pretests are shown in Table 8.11. 
Comparing approaches y the SC Approach surpassed the LE Approach by 
somewhat larger differences in all three reading scores and in spell- 
ing than in the unadjusted means shown in Table 8.7. The Pilot 
Method was slightly lower than the SC Aipproach in Reading, but main- 
tained its lead over SC in the other three subtests and was well 
ahead of the LE Approach on all four subtests. 

Within the SC Approach the effect of the pretest adjustment was 
to raise the PV means in all four subtests and especially in Reading; 
the BR means were lowered slightly except in Reading. On the ad- 
justed means BR and PV were approximately equal in Reading and Word 
Knowledge , while PV shewed a slight lead in Word Discrimination and 
Spelling. 

Within the LE Approach, LE showed a lead of one to three points 
over LE-AV in adjusted means on all four sub tests. 

Looking at all five methods, on Reading, BR was highest, fol- 
lowed closely by PV, and then by Pilot, LE, and LE-AV. On Word 
Knowledge, Pilot was highest, followed by LE, PV, and BR closely 
bunched, with LE-AV lowest. On Word Discrimination, Pilot was high- 

followed by PV, BR, LE, and LE-AV. On Spelling, Pilot was 
highest, followed by PV, LE, BR, and LE-AV. 

The results of the adjustment using the five first-grade Stan- 
ford subtests as predictor variables are shown in Table 8.12. This 
adjustment partials out differences in first-grade achievement and 
emphasizes the effects of learning during the second grade. 

The SC Approach was three points higher than the LE Approach 
in Reading and Word Discrimination, one point higher in Word Knowl- 
edge, and less than a point higher in Spelling. The hypothesis 
that the LE Approach would show greater gain than the SC Approach 
during Replication 2 was not supported by this evidence. 

Comparing the Pilot Method with the SC Approaches, Pilot 
over two points lower in Reading, less than a point higher in Word 
Knowledge, and over a point higher in Word Discrimination and Spell- 
ing. The Pilot Method was consistently ahead of the LE Approach, by 
less than a point in Reading, by over a point in Word Knowledge and 
Spelling, and by over four points in Word Discrimination. 

yithin the SC Approach BR was slightly ahead of PV in Reading 
and Word Knowledge, while PV was a bit higher in Spelling and over 
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two points higher in Word Discrimination. Within the LE Approach 
LE was consistently higher than LE-AV, by about three points in 
Reading, Spelling, and Word Discrimination, and by nearly five points 

in Word Knowledge. 



There was no support for the hypothesis that the LE-AV Method 
would show marked improvement in Replication 2. It should be noted 
that the LE Method by itself was slightly ahead of the means for the 
SC Approach in Word Knowledge and Spelling, and slightly lower in 
Reading and Word Discrimination. The LE Method was also ahead of 
the Pilot Method in Reading and Word Knowledge and not much lower in 
Spelling and Word Discrimination. 



On the post test adjustment, then, it seems appropriate to con- 
clude that the LE-AV Method was disappointing in Replication 2 and 
that the other four methods were nearly equal in second-grade learn- 
ing. 

Grade Equivalents 

The grade equivalents corresponding to the means adjusted by 
first-grade pretests are shown in Table 8.13. Since these are the 
results of two years of learning adjusted to equate for initial dif- 
ferences in readiness, they provide a better basis for judging the 
total learning in Replication 2 than either' the unadjusted results, 
or the posttest adjustments. For ease of comparison, the- Replica’^ 
tion 2 means are shown along with the corresponding means for CRAFT 2. 

Looking first at the tesults for all methods combined. Replica- 
tion 2 was one month higher than CRAFT 2 in Spelling , two months 
higher in Reading, one month higher in Word Discrimination, and one 
month lower in Word Knowledge. In comparison with the norm of 2.7 
for testing in April, the Replication 2 mean was one month below in 
Reading and Word Discrimination, and two months below in Word Knowl- 
edge and Spelling. Considering the disadvantaged population, these 
results may be regarded as highly satisfactory. 

The Replication 2 SC Approach means improved over the CRAFT 2 
means in Reading and Spelling , equalling the norm in Reading . In 
Word Discrimination the SC mean remained at the norm of 2.7. In 
Word Knowledge there was a loss from slightly above the norm to 
slightly below it. 

* 4 * • * i 

For LE Approach comparisons, there were slight gains in Reading 
and Word Discrimination, no change in Word Knowledge, and a two month 

gain in Spelling . ' 

Comparing the two Approaches for ■ Ref licatlon 2 , SC was higher 
than LE by three months in Reading, four months in Word Discrimina- 
tion and two- months in Word Knowledge and Spelling. 

However, most of the difference 
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Is due to the poor showing of the LE-AV Method; differences between 
SC means and those for the LE Method by Itself are only two months 
In Reading and Word Discrimination, one month In Spelling, and there 
Is no difference In Word Knowledge. 

The comparison of the Pilot results In Replication 2 with re- 
sults of the. classes taught by the same teachers In CRAFT 2 provides 
an opportunity to differentiate between the effect of the specific 
method and the expertness of the teachers using It. It may be noted 
In Table 8.13 that the Pilot mean grade equivalent decrees^ by two 
months In spelling, one month In Reading and Word Discrimination, 
and remained constant In Word Knowledge. 

Grade equivalent scores adjusted by first-grade post tests re- 
vealed results similar to those reported above. 

Results for Reading Interest Measures 

The results of measures that are related to the Interest of the 
children In reading and the nature and amount of their voluntary 
reading are shown In Table 8.14. 

On the San Diego. Inventory of Pupil Attitude the means for all 
five methods fell within a very narrow range (17.89 ’to 19.34) and 
are not significantly different. 

The scores for Books Read Completely and Books Read Partially 
were based on reports turned In by the teachers for a one-month 
period. In February and March. Since for every method the S.D. ex- 
ceeds the mean on these variables. It Is evident that the distribu- 
tions are markedly skewed and that the means are strongly affected 
by the high scores of a few avid readers. For this reason the dif- 
ferences among methods are difficult to Interpret. For example, the 
mean for Books Read Completely was 7.86 for PV and 2.21 for BR. How- 
ever when one notes the S.D. of 11.34 for PV, the significance of 
this difference Is questioned. 

I * 

The teachers rated each child for Eagerness to Read and Maturity 
of Choices. The ratings for Eagerness are within a fairly narrow 
range, with BR being the lowest method. On maturity the 

range Is again .fairly narrow. Since the rating stan- 

dards used by the different groups of teachers may not have been 
equivalent, small differences are of doubtful reality even If sta- 
tistically significant. It may be noted, however, that BR had the 
lowest means on the San Diego Pupil Inventory, the number of books 
read, and on teacher rating of eagerness to read. 

Results of the Subsample Measures 

The unadjusted results of the oral reading tests given Individ- 
ually to a sample of four children per class are shown In Table 8.15. 
On Gilmore Oral Reading Accuracy, scored In grade equivalents, there 
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was practically no difference between the means of the SC and LE Ap- 
proaches. The means for all methods fell between 3.04 and 3.47, a 
relatively narrow range, and all methods were well above the norm of 
2.7. PV had the highest mean and was four months higher than BR. 

LE and LE-AV were approximately equal. 

On Gilmore Rate, a measure of doubtful value at second-grade 
level, the mean difference between the two approaches was small. 

The LE Method had the highest mean rate and LE-AV the lowest. 

On the Gates Word Pronunciation Test the difference between the 
two approaches was practically nil. On the Fry Test of Phonetically 
Regular Words the SC Approach was three points higher than the LE 
Approach, due mainly to the poor showing of the LE-AV Method. 

The Pilot Metbrd was next to lowest on Gilmore Accuracy, but 
was highest by a substantial margin on the Gates and Fry word lists. 

The Gilmore Rate, Gates, and Fry scores were adjusted using the 
Metropolitan Readiness Alphabet and Matching subtests. The regres- 
sion equations are shown In Table 8.16 and the adjusted results are 
shown In Table 8.17. The trends shown In Table 8.15 are Increased 
In terms of differences between means, but the S.D.'s are greatly 
Increased and the relative size of the difference tends to be less- 
ened by the adjustments. 

The results for the measures based on the Writing Sample are 
shown In Table 8.18. On the whole, differences among methods were 
small In comparison to the variation within methods. The BR Method 
was highest In Number of Running Words, Number of Different Words, 
and Number of Words Spelled Correctly. The PV and LE Methods were 
about equal on these three measures, and the LE-AV and Pilot Methods 
were also approximately equal and lowest. In Number of Polysyllabic 
Words LE was highest, BR, PV, and Pilot were about equal, and LE-AV 
was lowest. 

Analysis of Variance Results 

One way analyses of variance were run by computer for the MAT 
scores adjusted by pretests and by posttests, and for the subsample 
measures. The results are summarized In Table 8.19. There were 16 
analyses for comparison of approaches and another 16 analyses for 
comparisons of the five methods In Replication 2. Table 8.19 omits 
most of the statistical details and shows only the degrees of free- 
dom and the F value for each analysis. 

The results of these analyses may be summarized very briefly! 
not one statistically significant difference. Consistently the vari- 
ances within methods were so large In relation to variances between 
methods as to prevent the ^ ratio from reaching a significant level. 
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Even on the Fry Test, on which the Pilot Method had a substantial*- 
appearing lead, ^ fell short of significance at the .05 level. 

A more complicated analysis of varlrnce was carried out for 
each MAT sub test adjusted by pretests, and also adjusted for post- 
tests. In this the Pilot Method was compared with the other methods, 
and a comparison was made of Replication 2 results with the CRAFT 2 
results of the same teachers. An example Is shown in Table 8.20 for 
MAT Word Discrimination adjusted by pretests and 12 analyses are 
sinnmarlzed in Table 8.21. None of the £*s, whether for differences 
among the four original methods, difference between Pilot and other 
methods, or differences between the two years. Is significant for 
this or the other MAT sub tests, whether adjusted by pretests or by 
posttests. 

Similar analyses were made for the subsample measures. Even on 
the Fry Test, on which fairly large differences in means of raw 
scores were Increased by the adjustment, the variance within methods 
was Increased still more and the highest F, value was 1.59, well short 
of significance. These are also summarized In Table 8.21. 

Comparison of Bovs and Girls* 

Comparisons were made between boys and girls on several tests. 
Including the pretest battery (Metropolitan Readiness) and the two 
posttests (Stanford Achievement administered at the end of Replica- 
tion 1 and Metropolitan Achievement given near the conclusion of 
Replication 2) . 

Pretest results Indicate uneven findings. The boys In Replica- 
tion 1 had higher mean scores than girls on Word Meaning and Listen- 
ing and the girls surpassed the boys on Matching and Alphabet. Sev- 
eral of these differences are significant (Table 8.22), especially 
when the total population Is used for purposes of the comparisons. 

Similar results are found In Table 8.23 where comparisons for 
boys and girls in Replication 2 are again made on the pretests. Boys 
show superiority over girls again on Word Meaning and Listening, ex- 
cept In two Instances where method by method comparisons are made. 
Girls do better than boys on Matching and Alphabet when the total 
population Is compared and when the sexes are compared by approaches. 
When children in methods are compared, PV boys do better than the 
girls on both of the subtests. 

Because of the differences noted on the pretests, posttests re- 
sults were adjusted to correct for the differences. However adjusted 
scores on both the Stanford and Metropolitan posttests were so similar 
to the raw scores that the following report excludes any reference to 
the adjusted scores. 



^Results for CRAFT boys and girls participating In both Replica- 
tion 1 and 2 are reported here since data for the Replication 1 study 
were not available at the time Chapter VII was written. 
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Replication 1 scores for boys and girls are revealed In Tables 8.24 
and 8.25. All but one of the comparisons favor the girls, although 
few of these differences are significant and grade equivalent dif- 
ferences are negligible, rarely exceeding one month. 

Most of the significant differences favoring the girls are 
found when the total population is used, irrespective of method cr 
approach. Here girls were better than boys on three of the reading 
sub tests and on spelling. Converting the means on these results 
into grade equivalent scores, the differences are never greater than 
one month on the reading sub tests. 

Using grade equivalent scores for these same populations, the 
mean achievement on the five subtests for the girls was slightly 
higher than 1.5 and for the boys, slightly higher than 1.4. The 
range of these grade equivalent totals is narrow; 1.5 - 1.7 for the 
girls, and 1.4 - 1.5 for the boys, except in the Pilot Method. 



Comparing the sexes on the basis of approach and method, girls 
out-scored boys in every Instance except three. The reversal in 
scores favored the boys In the BR and PV Methods and In the SC Ap- 
proach on Vocabulary. The differences, however, are not significant. 

In the Replication 2 findings (Tables 8.26 and 8. 27) the girls con- 
tinued to maintain their advantage over boys. Mean score and grade 
equivalent differences indicate female superiority in all but a few 
Instances. The differences favoring boys are slight and appear only 
in the LE-AV means for Word Knowledge and Reading. Differences fav- 
oring girls on the grade equivalent scores range from one month to 
1.2 years, and a majority of the differences are significant. 

In summary, the advantages held by girls over boys in Replica- 
tion 1 were maintained and increased through Replication 2. Only in 
LE-AV classes did boys enjoy a higher score than girls, and these 
differences were slight and non-slgnlf leant . These findings are simi- 
lar to those for CRAFT 1 and CRAFT 2. 

Comparison of Kindergarten and Non-Kindergarten Children 

Children in Replication 2 classes were used in carrying out a 
statistical analysis for children who had and who had not attended 
kindergarten. Results on the Metropolitan Readiness Test (October, 
1965), the Stanford Achievement Tests (April, 1966), and the Metro- 
politan Achievement Tests (April, 1967) were obtained. Number of 
children taking each set of tests were based on the Replication 2 
population only and varies slightly in that the N for kindergarten 
children ranged from a low of 226 on the MAT results to a high of 
230 on the Stanford results. Fifty-five non-kindergarten children 
took the two posttests and 56 took the pretests. Results of the 
tests are found in Tables 8.28 through 8.32. 
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On the pretests, shown In Table 8.28, the total kindergarten 
group did significantly better than the non-kindergarteners on three 
of the four sub tests and slightly higher on the fourth. Similar ad- 
vantages for kindergarten children were found when they were divided 
Into approaches and methods, with only two exceptions. In these 
latter Instances, the children without kindergarten did somewhat bet- 
ter than the kindergarten group on Word Meaning In the BR group and In 
the SC Approach. 

Means and S.L.'s for results of the Stanford posttests can be 
found In Table 8.29 along with grade equivalent scores In Table 8.30. 
Here the findings reveal significantly higher results for kindergar- 
ten children on nearly every comparison. Only In three Instances 
were non-kindergarten children superior, and these children were In 
the LE classes. 

In general kindergarten children achieved at a Stanford grade 
equivalent level of 1.5 as compared with 1.35 for non-kindergarteners. 
Almost all of these differences were significant. Comparing kinder- 
garten children by approach, the SC group scored slightly higher than 
the LE children on three sub tests. 

An analysis by methods reveals an uneven picture. lu the kin- 
dergarten group LE did better on Word Reading, Paragraph Meaning; the 
BR children, on Vocabulary and Spelling; and the PV children, on Word 
Study Skills. However, non-kindergarten children In the LE classes 
surpassed all other groups on three of these same tests: Word Read- 

ing, Paragraph Meaning, and Spelling. These findings are contrary to 
those found In CRAFT 1 where the kindergarten program appeared pri- 
marily to benefit the LE children. 

However, by the end of Replication 2, when the MAT posttests 
were given, the LE kindergarteners had surpassed the non-kindergarten 
group on all four MAT sub tests (Tables 8.31 and 8.32) although the 
differences were slight. 

All comparisons In Replication 2 favored the kindergarten group, 
sometimes by substantial margins. The SC kindergarten children, for 
example, averaged four months better than the non-kindergarten chil- 
dren In the same classes and their mean score on the four sub tests 
approximated the. national norms . The SC kindergarten children also 
averaged scores of two months higher than their LE counterparts, and 
kindergarten children In the BR classes did better than all other 
children. 

Summarizing the findings after two years of exposure to CRAFT 
Instruction, kindergarten children had consistently higher scores 
than non-kindergarten children, and those kindergarteners In the SC 
Approach and the BR Method had the highest means. These findings 
represent a reversal of findings In the CRAFT 2 study, where the LE 
children appeared to benefit most from kindergarten. 



124 



3. Relation of Teacher Variables to Outcomes 



In order to locate variables other than teaching method that 
had significant relationships with the second-grade results, class 
means were obtained for 60 variables and a 60 x 60 matrix of Inter- 
correlations was run by computer. Rather than presenting and attempt- 
ing to analyze the entire matrix, only the jc*s with the MAT sub tests, 
adjusted for pretests and posttests, will be analyzed In this report. 
The r,'s of the four MAT sub tests with the 60 variables are shown In 
Table 8.33. 

Since these r^'s are based on 25 classes, there are 23 degrees of 
freedom and the minimum r required for a P of .05 Is .396. Although 
it was possible in CRAFT”! and 2 to compute correlations with out- 
comes separately for each method, the small number of classes In Repli- 
cation 2 (four to six classes per method) made It impractical to com- 
pute r^'s for the separate methods. 

The teacher variables In Table 8.33 begin with no. 26, Teacher 
Competence Rating. This was the average of ratings on a one to five 
scale by the assistant project director and the district reading con- 
sultant i None of the _r*s for this variable are significant » indi- 
cating that teacher competence as perceived by the raters during 
classroom visits and discussions with the teachers Is not signifi- 
cantly associated with pupil achievement. 

Similarly low and non-significant correlations are found for most 
of the teacher variables. ITiere are no significant r_*s for teachers* 
age, total years of teaching experience, experience In second grade, 
class size, competence rating, teachers' absence, or ethnic similarity 
batifeen- teacher and pupils. Teacher competence ratings are shown in 
Table 8.34. 

The San Diego Teacher Attitude Inventory 

The three scales of the San Diego Teacher Attitude Inventory pro- 
duced just one significant _r» that between the Individualized scale 
and Spelling adjusted by pretests. Since it seems doubtful that 
classes which spent a large amount of time on Individualized reading 
were given more spelling drill than in the other methods, this result 
suggests that those classes \diich engaged in a substantial amount of 
Independent reading may have made Incidental gains in spelling. 

The results of the S-D Teacher Inventory are shown in Table 8.35. 
The SC Approach teachers scored significantly higher on the Basic 
scale than on the Individualized and Language-Experience scales. BR 
teachers scored somewhat higher on Individualized and Language-Experi- 
ence scales than the PV teachers did. The teachers in the LE Approach 
scored equally high on the Individualized and Language-Experience 
scales and were significantly higher on both than on the Basic scale, 
j UTiH there was little difference between the LE and LE— AV teachers. 
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The Pilot teachers showed a unique, pattern, being significantly higher 
on Individualized than on both Language Experience and Basic » but not 
significantly higher on Language Experience than on Basic. 

Thus the S-D Teacher Inventory confirms the presence of signi- 
ficantly differentiated patterns of teaching in the Replication 2 
teaching methods . 

Teacher Attitude Toward CRAFT Method Scale 

The Rating Scale of Teacher’s Attitude towards CRAFT Method 
was devised during 1966-67 to get at the teachers’ degree pf satis- 
faction with their assigned teaching method, willingness tp use. it. . , 
again, to recommend it to other teachers, etc. A copy may be found v 
in the Appendix. It was filled out by all Replication , 2 teachers '• ‘r-v 
near the end of the year. 

On a scale from zero to 50, all means for methods fell betwesn, , 
37.6 and 46.0, a fairly narrow range indicating generally high satis- 
faction (Table 8.36). The Pilot and BR means were the two highest^ ^ . 
and significantly higher than LE-AV which was lowest. All other : - ~ 
differences. between methods were non-significant. Since LE-AV was 
lowest both in teacher satisfaction and in pupil achievement*-; it, is 
not surprising to find a low but significant correlation between this 
scale and adjusted achievement, scores (Table 8; 33),. , , 

Dally Logs 

The Dally Log variables are numbered 44 to 60 in Table 8.33. . 
Although Reading Time had significant x’s with outcome measures in . 
CRAFT 1, there are no significant x’® ^9^ Reading Time, Suppprtiye 
Time, or Total Time in Replication 2. None of the six categories of 
Reading Activities had any significant X*®* 

Among the Supportive Activities, the only categories with signi- 
ficant X*® were Social Studies and Science categories, which were, used 
only by the SC teachers. Social Studies had significant x’® of .43 
with Reading adjusted by pretests and .50 with Reading adjusted by 
posttests. Science had significant x*® with Reading adjusted 

by pretests, .40 with Word Discrimination adjusted by posttests, had 
.55 with Reading adjusted by posttests. Evidently the use of substan- 
tial time on Social Studies and Science by teachers in the SC Approach 
was associated with performance above . expectancy in reading comprehen- 
sion. 



In CRAFT 1 and 2, in which the number of teachers per method -var- 
ied from nine to 12, X*® were computed ;by method as well as for the 
total group of teachers,, and some -significant findings emerged. It may 
be that the lack of significant x’® Replication 2 is due to the 
cancelling effects of putting together the Log results of teachers in 
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the five methods. However, the small number of teachers In each 
method (four to six) In Replication 2 made It Impractical to do 
jc*s for method. 

The mean times for the 20 Log variables are shown In Table 8.37 
and 8.38. It Is clear that the SC teachers spent more than half of 
their time on Reading Activities, less than half on Supportive Activi- 
ties, and much less than the requested 30 minutes per day on Social 
Studies and Science. The LE teachers spent more than half of their 
time on Supportive activities and less than half on Reading Activities. 
LE teachers spent much less time on AV Activities and AV with Discus- 
sion than the LE-AV teachers. The Pilot teachers had high means In 
both Phonics and Indlvldt;alized Reading. 

Thus the Logs again show that each teaching method had distinc- 
tive features. The general lack of significant correlations with 
outcomes should not be taken as contradicting the CRAFT 2 results, 
which showed some Interesting relationships when ^'s were computed 
separately by method. 



CHAPTER XX 



DISCUSSION, CONCLUSIONS, AND RECOMMENDATIONS 



In Chaptet I a number of specific objectives were listed. In 
Chapters V through VIII the data bearing on these objectives have 
been presented In detail^ y©ar by y©ar. With such an abundance of 
trees. It Is hard to see the forest. In the discussion below, an 
effort Is made to bring together and consider the total evidence 
related to each of the major objectives. Integrating the results of 
the five years of data collection rather than treating each year as 
a discrete unit. 

» . '.V * ' . • * , 

1. Achievement of the Total Experimental Population 

One of the objectives was to find out how the total CRAFT pop- 
ulation would achieve In reading and related language arts under 
the experimental conditions. So far as possible, conditions other 
than method of teaching and pertinent materials were kept represen- 
tative for the schools In which the project operated. Class size 
wao kept at the average size for the grade. Pupils were Initially 
selected at random from the entering first graders. Teachers parti- 
cipated on a voluntary basis. They were assumed to be representative 
of the teachers in their schools, since they ranged widely in age, 
experience, education, and rated competence. 

At the beginning of first grade the pupils, who were Negro 
children attending schools located in ghetto neighborhoods of New 
Tork City, scored well below the national norms on readiness tests. 

The Replication group too, although they scored slightly higher in 
readiness, were still well below the norm. 

On the Stanford Achievement Primary I, Form X, given as posttests 
in both CRAFT 1 and Replication 1, the mean grade score for all 
methods combined was approximately 1.5 which, although below the norm 
of l.S, was considered satisfactory for this population. 

On tests given near the end of second grade (Metropolitan 
Achievement Tests, Primary II) the mean grade equivalent for the 
total population in CRAFT 2 was 2.3 in Reading and Spelling and 2.4 
In Word Biiowledge and Word Discrimination. In Replication 2, the 
mean grade equivalents were 2,6 in Reading and Word Discrimination 
and 2.5 in Word Knowledge and Spelling. The Replication teachers 
achieved higher class means the second time than thejr had with the 
first group of pupils. 

The Replication 2 results demonstrate that with experienced 
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teachers whose motivation was heightened by experimental conditions 
that included in-service training and supervision, disadvantaged 
second graders performed very close to the norm in reading. 

Third grade results (CRAFT 3) have been obtained for the chil- 
dren in the original study. The results show mean grade equivalents 
of 3.4 in Reading, and 3.3 in Word Knowledge, in April. The growth 
in reading during the third year was .9 years in Reading and .8 
years in Word Knowledge. After three years of Instruction, the 
third grade experimental children were; then, three to four months 
below the norm. 

How the Replication children will do in third grade can only 
be discovered If a follow-up study of them is made. The Replication 
2 results warrant the hope that Replication 3 results will surpass 
those of CRAFT 3. 



2. Comparison of CRAFT with Non-CRAFT Children 

Two comparisons have been made which Indicate how the CRAFT chil- 
dren compared in achievement with those who entered the experimental 
classes late, and with those who left them early. 

In CRAFT 2 the late entrants were found to have lower achieve- 
ment results than CRAFT children, but only in the PV Method were 
these differences found to be statistically significant. Those who 
left the project during the first grade also achieved lower results 
than the CRAFT pupils. 

A rough comparison is possible between the third-grade results 
in the CRAFT schools in 1963 (the year before the beginning of CRAFT) 
and the CRAFT third graders . Third grade school medians for 1963 
were listed in the CRAFT 1 report (Harris' & Serwer, 1966 a, p.l3). 
Although most of the CRAFT analysis has utilized means, school medians 
were computed for the third grade CRAFT children in order to make 
comparisons with past achievement results. 

The median of school median grade equivalents in Word Knowledge 
was 2.8 in 1963 and 3.1 in 1967. The corresponding medians in 
Reading were 2.95 in 1963 and 3.4 in 1967. In Word Knowledge the 
range of school medians was 2.5 to 3.5 in 1963, while in 1967 the 
range was 3.0 to 3.6. The range in Reading was 2.6 to 3.4 in 1963 
and 3.2 to 3.9 in 1967.* Thus there seems to have been a substan- 
tial general Improvement, \dilch is most marked in the schools with 
lowest initial achievement. 



*Thls comparison became available after the typing of Chapter VI 
had been completed. 
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3. Comparison of Approaches and Methods 



The main comparison In CRAFT was between the Skllls-Centered 
Approach and the Language-Experience Approach. On first and second 
grade posttests the SC means were slightly higher than those for 
the LE Approach In Reading and Spelling In terms of both raw and 
adjusted scores. This was true In CRAFT 2 and was found again In 
Replication 2. In Replication 2, SC means were higher than LE Ap- 
proach means and when converted Into grade equivalents showed dif- 
ferences of three months In Reading, four months In Word Discrimi- 
nation, and two months In Spelling. 

However, the differences In outcomes among the classes within 
each approach were far greater than the differences between the 
means for the two approaches. Numerous analyses of variance have 
been carried out, and consistently the difference between approaches 
failed to meet the test for statistical significance. 

It should be noted here that all analyses of variance were 
carried out using the class mean as the statistical unit. Where 
the Individual child was used as the unit and simple jt-tests were 
employed — a far less rigorous approach — some of the differences 
appeared significant. The staff of this project believes that the 
more conservative practice of using analysis of variance based on 
class units Is the preferred procedure. 

The third grade Metropolitan city-wide test given In April, 
1967, provided the final criteria scores for the three-year CRAIT 
Continuation Study. The means for the LE Approach were for the 
first time higher than the SO means, both on unadjusted and adjusted 
scores, but when tested by analysis of variance the difference con- 
sistently fell within the range of chance variability. 

To summarize, the SC Approach had a small and non-slgnlf leant 
lead over the LE Approach during the first two grades In both the 
Continuation Study and the Replication Study. In the Continuation 
third-grade follow-up the LE gains were larger than the SC gains, 
and for the three-year period the LE Approach ended with a slight 
and non-slgnlf leant advantage. Essentially all methods ended even. 

The accelerated gain for LE during the third grade. In which 
most of the children were taught by variations of the BR Method, 
leads to Interesting speculations. Three alternative hypotheses 
have some plausibility: (1) It Is possible that the reading vocab- 
ulary used In the third grade reading materials filled In gaps In 
the reading vocabulary of LE children, so that their reading vocab- 
ularies coincided more closely with the vocabulary sampled In 
standardized tests. (2) It Is possible that the emphasis placed 
on oral language and enriched experience In the first two grades 
contributed to the third grade LE gains. (3) It Is possible that 
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systematic skills reviews in third grade may have filled gaps in the 
phonic and structural analysis skills of the LE children and thus 
have allowed their general reading competence to grow. 

Regretfully the CRAFT data do not provide evidence on the basis 
of which a choice can be made among these alternatives. Staff opln~ 
ion favors the conclusion that all three factors were Involved to 
some extent. 

BR vs. PV . There is currently a great Interest in the respective 
values of beginning teaching methods which stress the word recogni- 
tion or decoding aspects of reading, as compared to approaches \dilch 
stress meaning. According to the reports from the Coordinating 
Center (Bond & Dykstra, 1966; Dykstra, 1967), in representative, 
middle-class populations a variety of methods which stress decoding 
in early reading instruction obtained better results than those ob- 
tained with conventional basal readers. The same conclusion is 
reached in a current book (Chall, 1967) . 

A brief summary of the five years of CRAFT results is as fol- 
lows: whether combined with basal readers or with a language- 

experience method, intensive phonics has failed to show a decisive 
advantage in reading, or even an advantage that is statistically 
significant. 

In the original first-grade CRAFT study most of the differences 
between BR and PV were too small to be significant; the two signifi- 
cant differences (in Paragraph Meaning and In S-D Pupil Inventory) 
favored BR. In CRAFT 2 there were some differences favoring PV, 
mainly In tests of word recognition, but none of the differences was 
significant. On the third-grade foilow-up the two SC methods were 
again very similar in their results. In Replication 1 and 2 the two 
methods ended the second grade with identical adjusted grade equiv- 
alent means of 2.7 on MAT Reading, eq.ual to the norm. On other sub- 
tests, and particularly on the oral reading and word recognition 
tests given to the subsample, PV was ahead but not by a statistically 
significant margin. CRAFT results do not show superiority for a 
strong emphasis on decoding with disadvantaged children. CRAFT re- 
sults are similar to those of the second Nashville study (Dunn et. 
al., 1967), in which control classes using basal readers did as well 
as those using 1/t/a or Words in Color, both of \dilch stressed sound- 
symbol associations. 

Pilot . The Pilot Method represented an effort to test the combina- 
tion of PV phonics with language experience and audio-visual meth- 
odology. At first glance the results for the Pilot Method looked 
very good. A careful analysis disclosed that the Pilot teachers In 
both first and second grade had done as well or better with their 
original methods (PV or LE-AV) as they did with the Pilot Method on 
most measures. 
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The pretest scores provide a plausible explanation for the 
lack of significant advantage for the PV or Pilot methods. On the 
Murphy-Durrell Phonemes Test, a readiness subtest measuring audi- 
tory perception for sounds within words, the CRAFT population had 
done very poorly, with a mean falling within the bottom one per 
cent of the normative group (Harris & Serwer, 1966a, p. 59). This 
finding confirms several research studies which have reported poor 
auditory perception among Negro children. The CRAFT children as a 
group had shown a marked lack of readiness for learning by a method 
that relies heavily on ability to perceive and discriminate sounds. 
In contrast, their highest readiness score had been on Murphy- 
Durrell Learning Rate, a test of readiness to learn by a look-and*^ 
say procedure. Since the children taught by procedures stressing 
sound-symbol associations did as well as those taught In other ways. 
It Is evident that this disparity In Initial readiness was overcome 
during the course of Instruction. 

The Basal Reader Method. In planning the CRAFT research design 
three major precautions were taken to ensure that the BR Method 
would constitute an experimental method rather than be a control 
method In the usual way. Ttie first was to treat It on a par with 
the other methods In workshop sessions, class visits by project 
staff, etc. This procedure should have diminished If not el imi nated 
differences In the Hawthorne Effect. The second was to Insure 
that the BR teachers received complete basal materials. Including 
teacher's manuals, workbooks, and word and phrase cards. The third 
was to emphasize repeatedly the Importance of covering all activi- 
ties recommended In the manual Including the phonic £uid structural 
analysis activities. These three precautions would. It was hoped, 
allow a fair comparison of the BR Method with the other methods. 

The results show that under these conditions the BR Method can 
produce results that are not significantly different from those ob- 
tained In other CRAFT methods. Of particular Interest Is the simi- 
larity of BR results and PV resul.:s. 

LE vs. LE-AV. For the original CRAFT 1 results the LE-AV classes 
with full-session schedules had done equally as well as the SC meth- 
ods and better than the LE Method. During the year In which both 
CRAFT 2 and Replication 1 were conducted, there were prolonged In- 
terruptions of AV consultant service and two replacements, so that 
the LE-AV Method did not really have a fair tryout. During CRAFT 3 
and Replication 2 the disappointing results of the previous year 
probably served as a continuing handicap. 

The CRAFT results for LE-AV are probably not representative of 
the best that can be done with such a method for disadvantaged chil- 
dren. However, they do provide evidence that this method requires 
a high level of teacher training and support, as well as expensive 
materials and supplies. If It Is to be effective. CRAFT results 
failed to provide justification for the expenditures Indicated. 
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Achievement Patterns . In Replication 2 the mean grade score of 
3.2 on Gilmore Accuracy indicates above average ability in the 
mechanics of oral reading. 

Comprehension requires more than word Identification skills; 
it involves familiarity with language patterns, an adequate vocab- 
ulary, and a background of relevant information and concepts. The 
deficit In knowledge of word meanings which was conspicuous in the 
results of the first-grade pretests remained a handicap through 
the third grade, and probably reflects a limitation based on socio- 
cultural background which is unlikely to be overcome by any partic- 
ular method of teaching beginning reading. Both Word Knowledge and 
Paragraph Comprehension results lagged behind decoding or word 
recognition skills to the end of the third grade of CRAFT. In view 
of what is known about the cultural and educational disadvantages 
characteristic of children like those in the CRAFT study, it seems 
entirely reasonable and natural that they should have found it 
easier to learn word recognition and reproduction skills than to 
develop silent reading comprehension. 

Subsample Results 

In each year of the project a subsample of four children per 
class was selected from the CRAFT pupils and was tested with the 
Gilmore Oral Reading Test and the Gates and Fry word lists, the 
former based on frequency of occurrence, the latter on phonetic 
regularity. The subsamples were reasonably representative. 

One major finding has been that consistently the children in 
all methods equalled or exceeded the norms in Gilmore Accuracy and 
Gates, the two scores for which grade equivalents were available. 

In general the SC Approach has had a very slight advantage in 
Gilmore Accuracy and the PV and Pilot methods have done well on the 
word lists; Pilot did especially well on both Gates and Fry. The 
analysis of variance, however, failed to disclose significant dif- 
ferences attributable to method or approach. Although some of these 
differences looked significant when Jt-tests were based on individual 
pupil scores, the more rigorous analysis based on class means did 
not substantiate this. 

Results for the Writing Sample have been somewhat inconsistent 
from year to year, with the BR Method doing w^ll in both CRAFT 2 
and Replication 2, but most of the differences failed to show signi- 
ficant differences in the analysis of variance. 

The Importance of Differences Among Teachers 

While there were distinctive differences among the CRAFT methods, 
there were also many similarities. For example, while phonics was 
taught earlier and more intensively in PV and Pilot Methods, all of 
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the other methods devoted 10 to 15 minutes per day to phonics 
instruction. While experience stories were used as the main 
beginning reading materials in the LE Approach, they were also 
used at times as supplementary materials in Social Studies and 
Science by the teachers in the SC Approach. Individualized 
reading became the major reading activity in the second-grade LE 
classes, but some independent reading took place in SC classes 
also. Audio-visual procedures were stressed and focused on the 
reading process in the LE-AV and Pilot Methods, but incidental use 
of audio-visual activities occurred in all classes. Thus differ- 
ences among CRAFT Methods were mainly in emphasis and proportion 
rather than of the all-or-none variety. 

That there were genuine differences among the CRAFT methods 
has been validated with evidence from the Logs, from OScAR R, from 
the S-D Teacher Inventory, and from consultant visits. Since 
differences in outcomes were generally lacking in significance, 
the conclusion is inevitable that so long as no major reading 
objective is totally neglected, wide differences in time, sequence, 
etc. produce quite similar achievement outcomes. Teacher 
effectiveness in planning learning activities, in recognizing indi- 
vidual and group needs, in fitting the difficulty of material to 
the reading skills of the children, in maintaining motivation, 
and in providing appropriate individual learning activities, may 
be the main determiners of pupil learning. CRAFT results support 
the conclusion that the teacher is far more important than the 
method. 



4. Achievement of Special Groups 

In addition to comparison by approach and method, comparisons 
were made between children who had or hr 3 not attended kindergarten; 
between boys and girls; and between ear*y readers and the total 
population . 

Kindergarten vs. Non-Kindergarten 

On readiness measures at the beginning of CRAFT 1, kindergarten 
children had slight but non-significant advantages on three subtests, 
and significant advantages on tests of visual-motor ability, audi- 
tory discrimination and learning rate. There were small differences 
of about one month favoring the kindergarteners on first, second, 
and third-grade continuation posttests. These differences were 
larger for LE children than for SC children. In third grade, boys 
did equally well with or without kindergarten; in PV the boys with- 
out kindergarten had the advantage. Among girls the kindergarteners 
had an advantage. However, in the Replication study the kinder- 
garten advantage was larger, with SC kindergarten children 



approximately at the norm and four months ahead of the SC non— kinder- 
garten children on the Replication 2 posttests* While the LE 
Approach shoved more benefit from kindergarten in the original study » 
the SC Approach Indicated more advantage in the Replication Study* 
Reasons for this reversal are not known* 

Bovs vs* Girls 

In contrast to many previous reports of girls surpassing boys 
in readiness for reading, the CRAFT boys did almost as well as the 
girls on reading readiness tests* At the end of the first grade 
the girls had a slight but non-slgnlf leant lead* The differences 
increased during the second year and were still larger at the end 
of the third grade* 

Where exceptions existed favoring boys over girls they did not 
follow a particular pattern, nor were they significant* For example 
in CRAFT 2 and Replication 2 boys in the LE-AV classes outscored 
girls on selected sub tests of the KAT, and in the CRAFT 3 analysis 
did slightly better than girls on the Word Knowledge and Reading in 
the BR classes. In the other two methods, PV and LE, the boys 
were consistently lower achievers than girls. 

The fact that sex differences varied according to teaching 
method reinforces the evidence of the readiness tests to the effect 
that the CRAFT boys and girls began the first grade about equally 
ready to read. They do not negata the possible Influence of factors 
such as peer group attitudes, which may affect the achievement of 
boys adversely as they get older, or of differential treatment by 
teachers * 

Early Readers 

The group in the original CRAFT study who were identified at 
the beginning of first grade as early readers showed readiness well 
above that of the total population; had a substantial advantage in 
reading skills on first grade posttests; and continued to increase 
their lead through the second and third grades* Near the end of 
third grade their mean score was well above the grade norm. 

At the end of first and second grades the means for the SC and 
LE Approaches were nearly identical, but on the April third-grade 
tests those in LE had made • greater gain than those in SC. Since 
these relatively few children were scattered through many different 
classes, it seems unlikely that a particular teaching method in 
third grade produced the third-grade difference* 

It seems more likely that the nature of the training in first 



and second grades d'^veloped habits and attitudes that were somewhat 
different In the two approaches and led to differing rates of read- 
ing growth In third grade. It seems reasonable to speculate that 
the emphasis given In the second grade to Individualized reading In 
the LE Approach may have been a major factor In this difference. 

Does the superior progress of the early readers lead to the 
conclusion that all disadvantaged children should begin reading 
Instruction earlier than the first grade? Such a conclusion would 
not be warranted from the present evidence. Whether children simi- 
lar to the early readers would or would not become superior readers 
by third grade if they did not begin to read before first grade can- 
not be answered by CRAFT results, but will require further research. 
Also, If it should be found that children with high readiness 
benefit from reading Instruction before the age of six, this would 
not necessarily apply to the bulk of the disadvantaged population 
with low readiness. Further research on the value of earlier 
systematic reading Instruction for disadvantaged children Is clearly 
desirable. 



5. Instructional Time 

One of the major findings of the CRAFT Project is that variation 
in the amounts of Instructional time spent on various aspects of 
reading an d language arts instruction sometimes have significant 
correlations with pupil achievement. This confounds the relation- 
ships between teaching methods and results, and makes it difficult 
to determine whether teaching method, or Instructional time. Is more 
important in the results. Thus, the project has pointed out a major 
source of error which has not been controlled in many other compara- 
tive Investigations of reading methodology and therefore obscures 
the Interpretation of the results of those studies. 

Although efforts were made repeatedly by the research staff and 
consultants to get the teachers to adhere to the recommended time 
allotments, these efforts were only partially successful. Time 
actually spent, as determined from Dally Logs, showed substantial 
variations within each method. In CRAFT 1 and 2, it was possible 
to correlate time variables with adjusted reading achievement within 
each method. In Replication 1 and 2 there were not enough classes 
In each method to warrant such an analysis. 

Through the four years, teachers in the SC Approach slightly 
exceeded the requested 90 minutes per day for Reading and used sub- 
stantially less than the requested 90 minutes per day for Supportive 
Activities; most of the latter deficit was due to the small amount 
of time spent on Social Studies and Science. In the LE Approach 
the general tendency was for teachers to exceed the total of 180 
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minutes per day, but to devote more than half to Supportive Actlvl*- 
tles; thus the LE teachers tended In general to spend about ten 
minutes less per day on Reading than the SC teachers did. The con- 
sistency of this difference suggests that It Is Inherent In the 
nature of the two approaches. However, careful study of the parti- 
cular categories that had significant positive or negative relations 
with outcomes may point out specific ways In which the efficiency 
of each Instructional method can be Improved. 

In CRAFT 1 there was a significant positive correlation between 
total Reading time and outcomes for the BR, FV, and LE-AV Methods, 
but not for the LE Method. Supportive time had a significant rela- 
tionship with results only In LE-AV. For the BR teachers, time 
spent on Basal Reader and Sight Word Teaching was positively related 
to results. In FV the amount of time spent on Fhonlcs was not 
significantly related to outcomes. 

In CRAFT 2 the SC teachers spent 17 minutes per day less than 
the 180 minutes requested, but the deficit was mainly In Social 
Studies and Science. Two-thirds of the SC time C105 minutes per day) 
was spent on Reading and only one-third (57 minutes) on Supportive 
Activities. The LE teachers averaged 10 minutes less per day on 
Reading and 42 minutes per day more for Supportive. 

For the BR teachers In CRAFT 2 there was a significant positive 
jc for Listening to Poetry, and almost significant for Sight 
Words and for Other Reading. 

For the FV teachers in CRAFT 2 there was a high negative rela- 
tionship between Phonics time and results . Those FV teachers who 
spent the least time on Phonics tended to achieve the best results, 
suggesting that there Is a saturation point for phonic practice, 
beyond which It Is not desirable to go. 

For LE teachers there was a negative correlation for Listening 
to Stories, suggesting the desirability of more reading by the chil- 
dren and less reading to the children. Art Work with Reading had 
negative £*s in both CRAFT 1 and CRAFT 2 for LE teachers, indicating 
a tendency for excessive and non-productive time to be spent in 
this way. 

For LE-AV teachers in CRAFT 1 there was a positive relationship 
between AV time and results, which did not reappear In CRAFT 2. For 
the other three methods AV time tended to be negatively related to 
results, reinforcing the conclusion that If AV procedures are to be 
beneficial to reading Instruction, teachers must be well trained 
and guided In their use. 

In Replication 1 the teachers were Informed at the start of the 
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year conceiming the results of the Log analysis in CRAITO 1, and this 
deliberately planned feedback may be the major reason why none of 
the Log variables correlated significantly with outcomes. It seems 
reasonable that teachers became aware of overemphases and underempha- 
ses and made corrections accordingly. 

Similar feedback information was given to the Replication 2 
teachers, and for them, also, most of the jc’s with outcomes are not 
significant. One trend emerged: in the BR and PV Methods time spent 
in Social Studies and Science was positively related to outcomes. 

Since the general tendency was for SC teachers to spend less than 
the requested time in those two curricular areas, the results imply 
the desirability of utilizing content from these areas more fully 
in second-grade reading, particularly in supplementation to the use 
of basal readers. 

The fact that there were not enough Replication classes to 
warrant a separate correlational analysis for each method probably 
prevented additional meaningful relationships from being discovered. 
Thus, the. analyses by method in CRAFT 1 and 2 could neither be con- 
firmed nor denied ip the Replication analyses. 

The accuracy with which the CRAFT teachers recoifded their use 
of time on the Daily Logs cannot be exactly determined; a validity 
check wpuld have required prolonged classroom observations far beyond 
the research staff’s capability. There has been, however, no evidence 
from workshop discussions, classroom visits by the consultants, or 
the OScAR R observations to suggest any intentional inaccuracies. 

The use of some form of teachers* report on use of time is strong- 
ly recommended by the CRAFT staff for use in future research on 
classroom methodology. The 1230 Daily Log form used in. CRi^T shpwed 
that it is possible to compile and analyze such data with . automatic 
equipment, making such research practicable. 



6. Other Teacher Variables 



A number of teacher variables, such as age, amount of education^ 
total years of experience, years of experience in the grade, \diether- 
married or not, and ethnic similarity between teachers and pupils, 
showed generally low and non-significant relationships with learning 
outcomes. This conclusion is based primarily on the results of the 
Replication Study in which the teachers had all been in CRAFT during 
the preceding year. Teacher absence -had generally negative Jf*s 
with outcoines , but only in CRAFT 2 were these significant. Ratings 
of teacher effectiveness based on classroom visitation had positive 
relations to outcomes but most of them were close to zero. In gen- 
eral it seems safe to conclude that these characteristics, which were 
well equated among the methods, did not materially affect the compari 
sons of methods and approaches. 
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OScAR R 



The OScAR R was a special observational procedure developed 
specifically for use In CRAFT, and was used In CRAFT 1 and 2. Part 
of It provided scales designed to check whether the teaching methods 
were genuinely different, and these validated the presence of a 
significantly different pattern for each method. On the whole, those 
second-grade SC teachers who used a good deal of enrichment activi- 
ties of a language-e;xperlence type tended to get better results In 
reading than those who confined themselves rather narrowly to skills 
development . 

Motivational practices were also significantly related to read- 
ing achievement. Teachers who made a large number of. disciplinary 
statements tended to get poor results. High scores In "Negative 
Motivation" were significantly associated with poor results In the 
BR, PV, and LE Methods. "Positive Motivation" had negative correla- 
tions In the SC methods and positive correlations In the LE methods. 
This Interesting finding suggests that different styles are effective 
In different teaching methods. 

It would be a mistake to assume a direct causal relationship 
between motivational style and results. The number of times a teacher 
Interrupts with a disciplinary comment may be a by-product of effec- 
tive or poor lesson planning and presentation. Uninterested, bored, 
or frustrated children may create disturbances which the teacher then 
has to stop. On the other hand, liberal use of praise seems to have 
worked well In LE methods. 

The analysis of OScAR R results thus far has only scratched the 
surface, but has uncovered enough to encourage further research In 
which Intensive, prolonged classroom observations would attempt to 
discover why the supposedly same teaching method produces outstanding 
results for one teacher and Inferior results for another. Since 
differences among teachers In the same method were far greater than 
differences between methods, a determined effort to find out ^at 
produces these wlthln-method differences Is strongly recommended. 

Teacher Attitude s. The San Diego Teacher Inventory of Approaches to 
the Teaching of Reading provided evidence concerning shifts In the 
attitudes of teachers toward basic. Individualized, and language- 
experience methodology. At the beginning of CRAFT 1 all groups of 
teachers showed a slight preference for basic .methodology. By the 
end of the year each group shifted In a direction favorable to the 
method they had used. Similar trends were found for the second-grade 
teachers. During the Replication Study these trends crystallized 
still more. 

Most of the correlations between San Diego scale scores and 






pupil achievement were not significant. However, in second grade, 
there was a strongly negative relationship between PV teachers 
scores on the Basic scale and outcomes. This reinforces the find- 
ings from Logs and OScAR R to the effect that second-grade teachers 
who concentrated narrowly on skills did not get as good results as 
those who employed a substantial amount and variety of enrichment. 

At the end of Replication 2, the teachers were asked their 
opinions of the method they had used. Since the reliability and 
validity of the scale were not established, the results can. only be 
suggestive. The scale tended to have positive correlations with 
results. In other words, those who liked their method got good 
results, or those who got good results liked their method. The 
correlation does not indicate the direction of causation. It does 
indicate that satisfaction with a teaching method and effectiveness 
in using it are positively associated. 

7 . Other Variables 

A few additional variables were included in the research design 
and deserve some brief comment. 



Pupil Variables 

Reading readiness variables consistently had meaningful 
correlations with outcome measures, but since they were partialled 
out, they did not affect the adjusted scores. An experimental 
visual-motor test which was given to only a sampling of the children 
had X*® with both first and second grade outcomes that look promising. 

Pupil absence was generally low throughout the project and may 
be disregarde^d as an interfering variable since it was evenly bal- 
anced among the methods. 

Regulations of the New York City Board of Education prohibited 
the use of a group mental ability test such as the Pintner- 
Cunnlngham which was part of the cooperative first grade test battery. 
Thus the CRAFT population cannot be compared with other populations 
on a very important variable; a probably Important covariate could 
not be used; and the usual basis for studying the relation between 
ability levels and teaching method was not available. 

The CRAFT research staff wishes to go on record as recommending 
that the prohibition against using group mental ability tests for 
research purposes hampers the conduct of research, prevents the 
collection and analysis of necessary information, and should be 
rescinded. 

Chronological age has shown such negligible correlations with 
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reading in many other studies that it was not considered to be a 
likely covariate in CRAFT. Age was recorded but was ignored up to 
the final 60 x 60 intercorrelation matrix in Replication 2. There 
it showed significant £*s with adjusted second grade results, much 
to the surprise of the research staff. Means for CA were practically 
Identical for all methods, so this finding has no bearing on the 
comparison of methods. It suggests, however, that age should not 
be Ignored as a significant factor in the school readiness of dis- 
advantaged children. 

Community Variables 

Two measures of the status of the neighborhood in which each 
CRAFT school was located were obtained from census tract records: 
median Income and median education of adults. The schools all had 
disadvantaged populations, but neighborhood data Indicated that 
there were differences among schools in degree of disadvantage. 

This is not surprising considering the range in school median 
reading grades. 

It had been assumed that any community effects on the CRAFT 
children would show up in their readiness scores and would be can- 
celed by the adjusting procedure. After this report was nearly 
completed it was noticed that in the 60 x 60 matrix in Replication 2, 
there were significant r.*s between Median Education and adjusted 
posttests. A quick inspection showed that the four original CRAFT 
methods had between eight and nine years of median education, while 
the Pilot Method had a median of ten years. This added a little 
postscript to the conclusion previously reached, to the effect that 
the comparatively good results of the Pilot classes were due to 
factors other than teaching method. 



8. Some Limitations 

There are strong temptations, on completing a long and large- 
scale research project, to generalize broadly on the basis of the 
results. In the case of CRAFT a number of restrictions on the degree 
to which the results may legitimately be generalized need to be men- 
tioned . 

1. The child population is probably representative of disad- 
vantaged young Negro children growing up in segregated 
neighborhoods in large Northern cities. They are not 
necessarily representative of Negro children in smaller 
communities or in the South. Their results are not neces- 
sarily like those that might be obtained with other groups 
of disadvantaged children such as Spanish-speaking children 




or vlilt 6 children in Appalschlay or of middle-class Negro 
children. 



2. The teachers in the project were reasonably representative 
of the staffs of the schools in which they worked— large 
urban schools with many classes on each grade. 

3. The random assignment of pupils to classes was not character- 
istic of pupil classification practices in New York City 
schools . The degree to which the results might have been 
different if the more typical grouping practices had been 
followed is not known. 

4. The CRAFT classes were of normal size for the school and 
the teachers were not allowed to have help from student 
teachers or aids. How a lower class size or extra personnel 
would Influence effectiveness of the methods studied Is not 
known. 

5. At the beginning of the first grade the CRAFT classes had 
a uniform readiness program lasting one month in CRAFT I 9 
and a week less in Replication 1. It is not known what the 
effects of a longer or different kind of readiness program 
might have been; or of varying the time for pre-reading 
training according to the tested abilities of the children. 

6 . The basal readers used were those available in the schools 
in 1964. Conclusions based on their use do hot necessarily 
epply to newer series which have since been published. 

7. While language-experience approaches have common features, 
each has distinctive characteristics. Conclusions about 
the language-experience results in CRAFT apply to the kind 
of LE program described in Chapter IV. 

8 . The CRAFT populations did not include enough children ^o 
had pre-kindergarten or pre-first grade schooling of the 
Head Start variety to warrant the drawing of any conclusions 
concerning the effectiveness of such programs. 

9. The CRAFT results do not provide information about the pro- 
gress of the children beyond the third grade in the original 
study, of beyond the second, grade in the Replication study. 

10. CRAFT teachers were instructed to spend three hours a day 
in the teaching of reading and supportive activities — far 
more than was recommended in official syllabi when the 
project started. It is doubtful that similar results can 
be obtained with time allotments that are considerably 
smaller. 

142 



ERIC 




9. Recommendatldns 



1. The results strongly support the desirability of providing 
in~servlce workshops and expert consultative help for 
teachers, and especially for inexperienced teachers. 

The major conclusion to be drawn from the five years 
of results Is that the teacher Is far more Important than 
the method. Assistance provided by consultants who were 
perceived as helpers rather than as supervisors was 
probably the main reason for the favorable results obtained 
In all of the methods. For consultation to be effective, 
the number of teachers assigned to a consultant must be 
far smaller than It has been In New York City schools. Costly 
procedures such as smaller classes and provision of auxiliary 
personnel may continue to give disappointing results If 
teaching skills are not improved. 

2. The results suggest the desirability of modifying the kinder- 
garten programs for disadvantaged children In the direction 
of Including sequentially planned activities for the develop- 
ment of specific aspects of reading readiness. They sug- 
gest that children who show accelerated readiness may 
benefit from an earlier start In reading. 

s 

3. The results have not shown a decisive advantage for any of 
the methods used In the study. Evidence has been found that 
the amount of time devoted to specific phases of each method 
Is significant, and that the effectiveness of motivational ' 
patterns differs from one method to another. 

4. It Is recommended that efforts be made to analyze each 
teaching method In much finer detail and to study the effects 
of planned variations In teaching style as well as In skills 
and content. 

5. In a city with a mobile disadvantaged population the impact 
of moving on pupil achievement Is important. Children 
moving into CRAFT classes were found to be significantly 
handicapped in only one of the methods studied (PV) . If 
such a method is utilized, it should either be employed on 
a community-wide basis, or steps need to be taken to Insure 
that special help is given to new entrants. 

6. The excitement and motivation of being in an experimental 
study seems to have been in part responsible for the favor- 
able results of the CRAFT research. It is possible that 

the continuing Involvement of teachers in a program of study- 
ing and testing new methods and materials would be productive 
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of Improved results, regardless of the merits of the spe- 
cific factors being studied. 

7. CRAFT results have shown a significant relationship between 
teacher satisfaction with a method and her results with 
it, but do not provide a causal explanation. Further 
study is needed to clarify this important question. One 
possibility Is that when teachers find that a method works 
they learn to like It, even If originally opposed to It. 

The alternative Is that some teachers can do better with 
one kind of method and other teachers with a different 
method, so that method should be fitted to the teacher's 
characteristics. A research attack on this problem seems 
desirable . 

8. By the time the CRAFT Project was in its first year, a 
number of innovative ways of teaching beginning reading 
were clamoring for attention. Considering the cost of 
reading instruction and its central Importance in the lives 
flfiH careers of children, every innovation should be sub- 
jected to careful research. At present a set of new read- 
ing materials begins to compete for sales several years 
before impartial research data about it begins to appear. 

A continuing program of objective research and evalua- 
tion on new reading materials and methods, conducted on a 
large enough scale, with sophisticated research techniques, 
and for long enough periods of time. Is urgently needed. 

The cost of such a program is probably well beyond the 
resources of any one school system or professional group. 






CHAPTER X 



SUMMARY 

The CRAFT Project investigated the progress in reading of dis- 
advantaged urban Negro children from the beginning of the first 
grade through the third grade using two basic teaching approaches. 

The present report covers the continuation of the original study 
through second and third grades, and a replication study in first 
and second grades. The Skills-Centered Approach included two methods, 
a Basal Reader (BR> Method, using conventional basal readers, and 
a combination of basal readers with the Phonovisual system of 
teaching and identificational skills, the combination being called 
the Phonovisual (PV) Method. The Language-Experience Approach 
developed reading materials from the experiences and verbalizations 
of the children and gradually moved into individualized reading. 

It had two variants, a regular Language Experience (LE) Method, 
and a Language Experience, Audio-Visual (LE-AV) Method, in which 
several kinds of audio-visual supplementation were provided. 



1. Procedures 

In the main CRAFT Project, which received support from the 
U.S. Office of Education for three and a half years, teaching methods 
were controlled in first and second grade and a follow-up was 
conducted in third grade. In the Replication study the four original 
methods were repeated in first and second grade and a fifth method 
called Pilot, which combined features of the PV and LE-AV Methods, 
was added . 

The main CRAFT study began with 1,378 children who took first 
grade pretests in October, 1964. Of these, 1,141 remained tnrough 
the first grade posttests, 656 remained in experimental classes 
through the second grade post tests, and 1,128 were located in the 
third grade follow-up, 489 of whom had participated throughout the 
two years of controlled methodology and took the city-wide third grade 
reading tests in April, 1967. The Replication Study began with 799 
children \dio took the first grade pretests; 680 of them remained 
through the first grade post tests and 402 remained through the second 
grade posttests. 

The project operated in twelve New York City public elementary 
schools, located in disadvantaged neighborhoods, having almost 
exclusively Nos^^ pupils , and having third— grade medians in refiding 
at least a half year below the city norms prior to the study. Eleven 
of the schools trained in the project for two years and ten schools 
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completed the three-year program. 

In the first year there were 48 classes, 24 in each of the two 
approaches and 12 in each method. A balanced design placed two SC 
classes and two LE classes in each school, with each SC Method 
paired with the LE Method in three schools and with the LE-AV Method 
in three schools. Method combinations were assigned to schools at 
random; teachers in each school drew lots for or'' of the two methods; 
pupils were selected at random from the entering first graders in 
each school and assigned at random to the four experimental classes. 

Teachers were volunteers but otherwise representative of the 
primary grade teachers in their schools . They varied greatly in age 
and teaching experience. They received honoraria for the consider- 
able amount of extra time required by participation in the study. 

They were trained in the experimental methods by a combination of 
wortohop sessions, duplicated instructions and suggestions, and class 
visits by the consultants. Their teaching was observed by the con- 
sultants^ and by research assistants using an observational schedule 
called OScAR R. They recorded teaching time on Daily Log forms and 
periodically completed inventories of attitudes toward methods of 
teaching reading. 

Parents were contacted at the beginning of the study and encour- 
aged to believe that participation would be beneficial to their chil- 
dren. The parents were not involved in any way other than allowing 
their children to participate. There is no evidence of parental 
hostility to the program or of withdrawal of pupils because of 
parental dissatisfaction. 

Since the CRAFT Project was one of the 27 cooperating projects 
\^ich received support from U.S.O.E. in 1964—65, the testing program 
that year utilized the same pretests and first grade posttests as 
the other projects. In the second and third grade continuations, 
and in the Replication Study, the Metropolitan Achievement Tests 
were used Instead of the Stanford. Subsample populations were given 
the Gilmore Oral Reading Test and the Gates and Fry word lists, 
as well as having their Writing Samples scored. Pupils also responded 
to a scale of Interest in reading, had their independent reading 
recorded, and were rated for interest in reading and maturity of 
choices . 

Statistical treatment was carried out using the class as unit 
when appropriate. Means and standard deviations were obtained for 
raw scores; for scores adjusted on the basis of first grade pretests; 

for scores adjusted on the basis of the posttests for the pre- 
ceding grade. Grade equivalents were also obtained. Significance^ 
of difference was tested by analysis of variance and, when appropriate, 
by jt-tests. A large number of variables were correlated with adjusted 
outcome measures, and those with significant correlations were given 
further study. Special comparisons were made of children with and 
without kindergarten, of boys and girls, and of early readers. 
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Analyses were also made of the Daily Logs, the OScAR R scales, and 
the San Diego Teacher Inventory. 



2. Results . 

1. The main finding, idilch held for all five years, was that 
differences in class means within each method were much 
larger than differences between the means for approaches 
and methods. When tested by analysis of variance, nearly 
all comparisons between approaches and between methods 
fell within the range of possible chance variations. 

2. During the first and second grades in both the original 
and replication studies the SC Approach had slightly 
higher means than the LE Approach, with the differences 
not large enough to be significant. By the end of the 
third grade, the LE means were slightly higher than the 

SC means, again with margins not large enough to be signi- 
ficant. The LE children made slightly greater progress 
during the third grade, so that the two approaches had 
essentially equal results for the three-year period. 

3. CRAFT school medians for the third grade substantially 
surpassed the third grade medians for the same schools 
in the period just prior to the CRAFT experiment'^ 

the difference amounting to 4.5 months in reading coni- 
prehenslon. 

4. When the majority of the teachers taught again with the 
same methods in the Replication Study, the results at 
the end of grade two were someidiat better than those of 
the original CRAFT study. In Replication 2 the grade 
equivalent means for the SC Approach, adjusted for pre- 
tests, were at the norm in reading comprehension. 

5. Differences between results of the BR and PV Methods were 
generally small and non-slgnlf leant . 

6. Differences between results of the LE and LE-AV Methods 
were in general not significant. The LE-AV results were 
impaired by interruption of audio-visual consultant 
services and therefore are not considered to show what 
the method can do under favorable conditions, but do not 
suggest that the additional expenditures required are war- 
ranted in terms of improved reading skill. 

7. Although the Pilot Method produced good results in the 
Replication study, the teachers using it had done as well 
or' better in reading and spelling in the original study. 
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^i^^ng one of the original methods* thus Pilot results are 
attributed to teaching skill rather than to the particulars 
of the method. 

8. CRAFT children as represented by the subsamples, tended to 
score higher C^od above the norm) In accuracy of oral reading 
and In word Identification than In reading vocabulary and 
comprehension. This held true In all methods and while 

the methods putting early stress on word Identification 
skills (PV and Pilot) tended to have higher means on these 
tests, most of the differences were not significant. 

9. At the start of the first grade, girls tended to have 
slightly higher means on some readiness tests and boys on 
others. Differences in favor of girls tended to increase 
during the second and third grades. The Replication pre- 
tests wf^re about evenly balanced between the sexes and boys 
were slightly and non-significantly ahead in the LE-AV 
Method. The differences favoring girls were largest in the 
LE and PV Methods, small or non-existent in the BR and 
LE-AV Methods. This linking of differences in achievement 
with teaching methods strongly suggests that for this popu- 
lation the feminine advantage is environmentally rather 
than biologically produced. 

10. Kindergarten children had consistently higher scores than 
non-kindergarten children on the first grade pretests and 
on all sets of posttests. Differences were quite small in 
first grade and tended to increase through the third grade. 

In the continuation study through third grade the advantage 
was greatest for LE kindergarten children, but in the 
replication study the kindergarten children in SC classes 
showed wider margins of advantage through second grade. 

11. Children who were identified by their teachers as being 
early readers at the beginning of first grade surpassed 

the total groups on the pretests and on all sets of posttests. 
By the end of third grade these children were well above 
grade norms in reading but not in arithmetic. The good 
progress of this group suggests that an early start may be 
beneficial to disadvantaged children who are initially 
high in readiness. 

12. SC teachers tended to spend more time on Reading and less 
time on Supportive activities than LE teachers in the first 
and second grades. In the original first grade study 
there was a significant positive correlation between Reading 
time and class achievement in reading. These results 

were reported to teachers and in subsequent years of the 
project this relationship was not found again. Differences 
in instructional time can be a major source of uncontrolled 
variance in research on classroom methodology. 
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13. In the first CRAFT year it was evident that three of the 
methods produced relatively good results when their 
distinctive features were given added time. This was 
not true of the PV Method, and in second grade the negative 
correlation between Phonics time and outcomes showed that a 
heavy concentration on phonic drill can go with poor 
results. The small number of teachers per method made it 
difficult to intejrpret the' correlations between instruc- 
tional time and outcomes, since' the criteria for statis- 
tical significance were necessarily severe. 

lA. The OScAR R (Observational Schedule and Rating - Reading) 
produced some interesting results. High Control scores, 
indicating frequent efforts to maintain discipline, were 
associated with relatively poor achievement. There was a 
trend suggesting that emphasizing praise and avoiding 
scolding is associated with good results in the LE Approach, 
but not in the SC Approach. In second grade the SC 
teachers who enriched their programs with a considerable 
amount of language-experience activity (particularly with 
Social Studies and Science content) tended to get better 
results than the SC teachers who focused more narrowly on 
reading skills; this was particularly true in the PV Method. 

15, On the San Diego Teacher Inventory of Approaches to the 
Teaching of Reading all groups began the first grade with 
a slight bias favoring basal methodology. At the end of 
first and second grades the SC teachers were significantly 
higher on the basic scale and lower on the individualized 
and language— experience scales, while the LE teachers became 
significantly lower on the basic scale and higher on the 
Individualized and language-experience scales. Thus each 
group of teachers moved toward more complete acceptance of 
the methodology they had learned to use. However, most of 
the correlations between teachers* attitudes on the San 
Diego scales and pupil achievement were not significantly 
greater than zero. 

16, Pupil attitude toward reading, as measured by the San Diego 
Pupil Inventory, was essentially similar in all methods 
after the first year. The method of instruction to which 
the children were exposed apparently did not differentially 
effect related components of pupil achievement such as 
eagerness to read, the maturity of the child's choice of 
reading material, or the number of books read. 

17, A large number of variables was demonstrated not to have 
Interfered with the comparison of approaches and methods, 
either by having non-significant correlations with reading 
results , or by being evenly balanced among the teaching 
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methods. This conclusion applies to the four original 
methods but not to the pilot Method, which was found 
to have had the benefit of better than average teachers 
and better than average neighborhood Income. The vari- 
ables checked Included pupil age, absence, and readiness 
scores; teacher age, marital status, education, years of 
experience In total and In the specific grade, rated 
competence, and ethnic similarity to or difference from 
the pupils; adult education and income in the neighbor- 
hood. 
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Table 3.1 



Assignment of ^thods to CRAFT 2 Classes 



Method 








S 


c h 0 o 31 s 










Total 

Classes 


A 


B 


C 


D 


E 




H 


I 


J 


K 


L 


ER 


- 


2 


2 


- 


- 


2 


•- 


2 


2 


- 


- 


10 


IV 


2 


- 


- 


2 


1 


- 


1 


- 


- 


2 


2 


10 


LB 


2 


- 


2 


- 


1 


1 


- 


1 


- 


- 


2 


9 


AV 


- 


2 


- 


2 


- 


- 


1 


- 


2 


2 


- 


9 


Total 


























Classes 


4 


4 


4 


4 


2 


3 


2 


3 


4 


4 


4 


38 



School F left the CRAFT J^oject in June 19$ 






Table 3*2 



Pupil Loss by School and Borough from Beginning of 
CRAFT 1 through the End of CRAFT 2 





Number of Children 




School 


Pretest Grade 1 


Posttest Grade 2 


Loss 


A 


122 


80 


42 


B 


no 


59 


51 


C 


no 


$ 


45 


D 


101 


64 


37 


E 


99 


32 




G 


102 


44 


58 


H 


n5 


35 


80 ^ 


I 


137 


53 


" 84 


J 


n4 


75 


39 


K 


n9 


81 


3a 


L 


123 


68 


55 


Total 


1,252® 




596 


Per cent 


of Loss: Queens ^3*3^ 

Brodklyn 5^*3^ 
Manhattan 40*1^ 
Total hj.6f> 







^ Total does not include school F which withdrew from the CRAFT 
Project in June^ 19^* 

^ Itaber of children used for adjusting I4AT scores* 
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Table 5* 5 



Pupil Loss by School and Borough 
from CRAFT 1 Posttests through CRAFT 2 Posttests 





Number of 


Children 




School 


Posttests CRAFT 1 Posttests CRAFT 9 


Loss 


A - 


ON 

CO 


80 


9 


B 


Ok 


59 


25 


C 


90 


® 


25 


V 

D 


8o 


64 




E 


30 


52 


48 


6 


88 


44 


44 


H 


102 


35 


67 


I 


114 


55 


6l 


J 


98 


*75 . 


25 


K 


105 


81 


24 


L 


109 


68 


4l 


Total 


1,059®' 




335 


Per cent 


of Loss: Queens 55-OJ& 

Brooklyn 45-5^ 








Manhattan 19- 
Total 5^-9^ 




; . 



® Total does not include school F which withdrew from the CRAFT 
Rroject in June> 19® • 

^ Number of children used for adjusting MAT scores. 
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Table 



Per Cent of CRAFT 1 Children in CRAFT 2 Classes 
by Method and Approach 



Approach and 
Method 


No. of 
Children 
in CRAFT 2 
Classes 


No. of CRAFT 
Children 
in CRAFT 2 
Classes 


Per Cent CRAFT 
Children 
in CRAFT 2 
CleuBses 


Skills»Centered 








BR 


285 


166 


58.2^ 


rv 


284 


201 


70.8 


Total 


569 


567 


64.5 


Language-Experience 






LB 


255 


145 


57.5 


LB-AV 


255 


144 


56.9 


Total 


506 


289 


57.1 


Total 


1,075 




6 i.o^ 



^ Number of CRAFT 1 children in CRAFT 2 classes is the number per 
class used for adjusting pi^il MAT scores. 
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Table 



CRAFT 1 Pretests and Fosttests for the 
Final Population in CRAFT 2 Conpared with the 
Final Population of CRAFT 1 



Test 


Final Population 
Grade 2 Grade 1 

Mean Mean 

Score Score 


Mean 

Diff. 


t 


Pretests 


Muzphy-Durrell Learning Rate 


7.65* 


8.17** 


-0.54 


’ -3.31** 


Thurstone Pattern Copying 


a .?6 


2.69 


0.07 


0.45 


Met. Word Meaning 


5>28 


5.25 


0.03 


0.34 


Met* Listening 


6 * 3 o 


6.79 


O.OL 


0.10 


Fosttests 


SAT Word Reading 


15*6*1^° 


I3.te“ 


0.22 


0.88 


SAT Paragraph Meaning 


10.37 


10.18 


0.19 


0*66 


SAT Vocabulary 


14.36 


14.35 


0.01 


0.Q5 


SAT Spelling 


6.82 


€.51 


0.31 


1.38 


SAT Word Study Skills 


26.93 


25.98 


0.95 


2.$** 



**P<.01 

N's vary between 6^6 and 6 u 
^ N’s vary between 1 , 22 ^ and 1^062 
^ N's vary between and 6^2 
^ N's vary between 1,127 and 1,101 
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Table 3*^ 






CRAFT 2 Class Size as of May, I 966 



o 

ERIC 



hiaiffliifftatTiaaiJ 



Approach and Method 


Total N 
Pupils 


Total R 
Classes 


Mean 

Size 


Range 


Skills-Centered 


BR 


263 


10 


26.3 


25-50 


PV 


275 


10 


27.5 


20-55 


Total 


558 


20 


26.9 


20-55 


Language-Experience 


LB 


212 


9 


23*6 


8-27 


I£-AV 


250 


9 


25.6 


14-34 


Total 


442 


18 


24.6 


8-34 


Total 


980 


>3 


25.7 


8-35 



l5o 



I 



Hi 



Table 5*8 



Niimber of Boys and Girls in CRAFT 2 



Approach and Method 


Boys 


Girls 


Total 


SC Approach 


BR 


81 


85 


166 


PV 


102 


J2. 


201 


Total 


183 


l84 


567 


LE Approach 


LE 


74 


71 


1^^5 


LE-AV 


Jk 


70 


144 


Total 


l48 


Ikl 


289 


Total All Methods 


551 


"■25 


656 







Table 3.9 
Age of Teachers in 


CRAFT 2 








Skills 


-Centered Approach 


Language-Experience Approach 




BR 


PV 


Total 


LE 


LE-AV 


Total 


N Teachers 


10 


10 


20 


9 


9 


18 


Mean Age 


41.70 


54.20 


57.95 


42.56 


51.56 


57.06 


Median Age 


50.50 


30.00 


Z6.3O 


44.00 


27.00 


52.50 


S. D. 


15.54 


10.48 


15.77 


10.25 


11.25 


12.09 


Age Range 


21-60 


22-5; 


21-60 


27-55 


22-57 


22-57 
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Table 5.10 



Educational Level of the CRAFT 2 Teachers 



Skills-Centered Approach Language-Experience Approach 
BR PV Total LE LE-AV Total 


Less than B.A 


0 


0 


0 


0 


0 


0 


B.A. 


k 


5 


9 


* 


4 


7 


B.A‘. + 


h 


✓ 


7 


5 


y 


8 


M.A. 


2 


0 


2 


1 


1 


2 


M.A. + 


0 


2 


2 


0 


1 


1 



Table 5.11 

Total Years of Teaching Experience, CRAFT 2 



Skills "Centered Approach Langiiage^Experience Approach 





BR 


PV 


Total 


LE 


LE-AV 


Total 


N 


10 


10 


20 


9 


9 


18 


Mean 


6.90 


5.70 


6.50 


7.59 


5.55 


5.56 


Median 


5.00 


5.00 


5.00 


8.00 


2.00 


5.75 


S.D. 


7.96 


5.98 


6.55 


5.29 


2.86 


5.69 


Range 


0-22 


1-11 


0-22 


5-l4 


0-7 


0-l4 



Tbble 3*12 



Second Grade Teaching Experience, CRAFT 2 





SC Approadi 




- 


LE Approach 




BR 


PV 


Tbtal 


LE 


LE-AV 


Total 


H 


10 


10 


20 


9 


9 


18 


Mean 


2.50 


2.60 


2.55 


5.33 


1.33 


2.33 


Median 


1.50 


2.00 


2.00 


3.00 


1.00 


2.00 


S.D. 


2.80 


2.33 


2.56 


2.11 


1.56 


2.11 


Range 


0-9 


0-8 


0-9 


0-8 


0-5 


0-8 








0 



Table ^.1 



Comparison of M^T Raw Scores for CRAFT and 
Non-CRAFT Children in the Same Classes, CRAFT 2 

(Class as Unit) 



Subtest 


Method 


Mean 


t 


CRAFT 


Non-CRAFT 


Word IQiowledge 


BR 


19-71 


15.65 


1.45 




PV 


l8«66 


12.89 


5.45^** 




LE 


17-1^ 


15.77 


1.42 




LE-AV 


17 


16.08 


0.90 


Reading 


BR 


24.01 


21.48 


0.66 




PV 


24.52 


17.79 


4.55»* 




LB 


25.56 


19-84 


1.26 




LE-AV 


22.16 


21.10 


0.55 


Word Discrimination 


BR 


22.95 


19-24 


l;70 




PV 


25.52 


16.69 


5.65»* 




le 


21.61 


19.21 


1.58 




LE-AV 


20.70 


19.07 


1.07 


[felling 


BR 


15.65 


12.11 


i.4l 




PV 


15.76 


8.99 


5.69** 




LE 


14.01 


11.50 


I.l4 




LE-AV 


14.58 


11.82 


1*92 


Arithmetic^ 


BR 


2.15 


2^01 


0.86 




PV 


2.10 


1.92 


1.28 


■ 


LE 


2.15 


1.98 


1.19 




LE-AV 


2.04 


1.97 


0.52 



^ These are mean grade equivalents 

*»P <.01 
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T&ble ^.2 



Conparison of Obtained Mean Grade Equivalents for CRAFT 
and Non-CRAFT Gdldren in Same Classes, CRAFT 2 



Subtest 


Method 


Mean Grade Equivalent 


CRAFT 


Non-CRAFT 


Word Knowledge 


BR 


2.6 


2.3 




PV 


2.5 


2.1 




LE 


2.4 


2.2 




LE-AV 


2.4 


2.3 


Reading 


BR 


2.3 


2.2 




PV 


2.5 


2.0 




LE 


2.5 


2.1 




LE-AV 


2.2 


2.2 


Word Idscrimination 


BR 


2.5 


2.1 




PV 


2.5 


2.0 




LE 


2.4 


2.1 




LE-AV 


2 9 ^' 


2.1 


Spelling^ 


BR 


. 2.4 


2.1 




PV 


2.4 


2.0 




LE 


2.5 


2.1 




LE-AV 


.2.3 


2.1 



^ National norms used; no New York City norms available 
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Table ^.4 

Obtained Grade Equivalent Means for MAT Fosttests^ 
CRAFT 2 (Class as Unit) 



Method 

aod 

Approach 


Word 

Khoirledge 


Word 

Diserimi* 

nation 


Reading 


^elling^ 


Arith- 

metic 


Skills-Centered 


BR 


2.6 


2.5 


2.5 


2.5 


2.4 


IV 


2.5 


2.5 


2.5 


2.4 


2.4 


Total 


2.5 


2.5 


2.5 


2.4 


2.4 


Language-E]qperience 


LB 


2.4 


2.4 


2.5 


2.5 


2.4 


LB-AV 


2.4 


2«5 


2.2 


2.5 


2.3 


Total 


2.4 


2.5 


2.5 


2.5 


2.4 


All Methods 


2.4 


2.4 


2.5 


2.3 


2.4 



^ National Norms 
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Correlation Matrix of CRAFT IFreteete end Poetteete end CRAFT 2 Fostteete 
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T&ble ^.6 

Regression Equations for M^T Scores 
Predicted by First*6rade Pretests, CRAFT 2 



Variable 


C Xi 


Xg 


X5 Xj^ 


*5 


MAT Word Knowledge 


Y = 5.208 + 0.000 + 


.647 + 


.473 + .445 + 


.666 


MAT Word Discrim. 


Y « 9.836 + 0.000 + 


.642 + 


.4Q7 + 0.000 + 


.9'^5 


MAT Reading 


Y » 6.057 + 0.000 + 


.677 + 


.712 + .546 + 1;125 


MAT Spelling 


Y = 5.391 + 0.000 + 


.600 + 


.505 + 0.000 + 


.920 



= Kindergarten Esqperience 
= Murphy-Durrell Learning Rate 
X, = Ihurstone Pattern Copying 
3^ « Metropolitan Word Meaning 
X^ s Metropolitan Listening 
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Table 5*7 



Regression Equations for M^T Scores 
Predicted by First-Grade Posttests^^ CRAFT 2 



Variable C X^ 

MAT Word Knowl. Y » 1.6?5 + .271 + .156 + .21^^ + .588 + .225 
MAT Word Discrim. Y « 7.269 + .272 + 0.000 + 0.000 + .449 + .506 
MAT Reading Y »= 1.487 + .557 + .155 + .555 + .461 + .289 
MAT [felling Y « .564 + .227 + 0.000 + 0.000 + .697 + .267 



Y » Constant + Xj^ + Xg+X^ + 3q^+2^ 
s Stanford Word Reading 

Xg ^ Stanford Paragraph Meaning 

X7 - Stanford Vocabulary 

5 

3^ = Stanford Spelling 

Xc = Stanford Word Study Skills 



a 



171 



o 

ERIC 



Table 5*S 



MAT Fosttest Results Adjusted by First-Kirade Pretests, 

CRAFT 2 

(Class as Unit) 






Method 

and 

Approach 






MAT 


Sub 


test 


s 






Word Knowl. 


Word Discrim. 


Reading 


Spelling . 


Mean 


S.D. 


Mean 


S.D. 


Mean 


S.D. 


Mean 


S.D. 


SC Approach 


















BR 


20.97 


9.90 


25.50 


7.50 


24.57 


14.02 


18.95 


8.95 


PV 


18.88 




24.28 


5.05 


24.99 


6.85 


15.81)- 


6.65 


Total 


19.95 


8.82 


25.89 


6.41 


24.68 


11.04 


17.58 


8.02 


LE Approach 


















LE 


16.52 


8.75 


21.09 


5.50 


22.97 


9.96 


12.69 


8.18 


LE-AV 


16.59 


6.69 


19.59 


5.74 


20.92 


6.95 


15.82 


5.81 


Total 


16.55 


7.79 


20.24 


4.78 


21.95 


8.64 


13.25 


7.12 




172 



o 

ERIC 



Table 5*9 



MAT Posttest Results Adjusted jjxx^u-Grade Posttests, 

CRAFT 2 

(Class as Unit) 



Method 

and 

Approach 




MAT i 


3 u b t 


e s t s 








Word Xhowl. 


Word Discritn. 


Reading 


Spelling 


Meein 


S.D. 


Mean 


S.D. 


Meein 


S.D. 


Mean 


S.D. 


SC Approach 




* 














BR 


19.62 


8.65 


22.41 


6.14 


22.66 


11.54 


17.52 


6.89 


PV 


18.89 


6.71 


24.34 


4.10 


24.97 


6.14 


16.05 


5.31 


Total 


19.26 


7.75 


25.38 


5.31 


23.82 


9.32 


16.78 


6.19 


LE Approach 


















LE 


17.38 


7.^3 


21.91 


4.15 


24.20 


8.53 


15.28 


6.51 


LE-AV 


17.51 


7.08 


20.07 


3.7^ 


21.96 


6.07 


14.66 


4.92 


Total 


17.^ 


7.26 


20.99 


4 .06 


25.08 


7.^9 


13.97 


5.81 


All Methods 


18 .40 


7.58 


22.25 


4.91 


23.47 


8.51 


15.45 


6.18 



Table 5*10 



Grade Equivalents for MAT Posttests Adjusted by 
First-Grade Pretests, CRAFT ^ 

(Class as Unit) 



Method 



Approach 


Word Khovl. 


Word Discrim. 


Reading 


Spelling 


SC Approach 










BR 


2.7 


2.5 


2.5 


2.7 


PV 


2.5 


2.6 


2.4 


2.4 


Total 


2.6 


2.6 


2.4 


2.4 


LE Approach 












2e5 


2.5 


2.5 


‘ 2.1 


- LE-AV 


2.h 


2.1 


2.2 


2.5 


Total 


2.4 


2.2 


2.5 ' 


2.5 


All Methods 


2.4 


2.4 


2.5 


2.5 



^ National norms used 
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Table ^.11 



Grade Equivalents for M^T Fosttests 
Adjusted by Posttests, CRAFT 2 
(Class as Unit) 



Method and 
Approach 


Word I&iowl. 


Word Biscrim. 


Reading 


Spelling®’ 


SC Approach 


BR 


2.6 


2.4 


2.5 


2.6 


FV 


2.5 


2.6 


2.4 


2.4 


Total 


2.5 


2.5 


2.5 


2.5 


LE Approach 


LE 


2.4 


2.4 


2.5 


2.2 


LE-AV 


2.4 


2.2 


2.2 


2.5 


Total 


2.4 


2.5 


2.5 


2.5 


All Methods 


2.4 


2.4 


2.5 


2.5 



^ Rational norms used 
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Table 5*12 



Significant t Cooqparisons between Methods 
on MUT Posttests^ CBAFT 2 
(Class as Unit) 



Subtest 


Mean^ 


S.D.j^ 


MeaUg 


S.D.g 


t 


Word Discrimination Adjusted 


PV 




LE-AV 


2.18*^ 


by Pretests 


24.25 


5.52 


19.55 




Word Discrimination Adjusted 
by Posttests 


24.34 


4.U) 


20.07 


5.74 


2.25* 



* P<.05 
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Table 5*15 



Range of Rav Score Class Means for 
Grade Eq\iivalents for MA.T Posttests, CRAFT 2 
(Class as Unit) 



Method 




Word Knoirl* 


Word Biscrim. 


Reading 






Mean 


G.E. 


Mean 


G.E. 


Mean 




BR 


High 


51.5 


5.7 


50.8 


3.6 


44.5 


4.2 




Low 


13.4 


2.0 


17.2 


2.0 


18.0 






Range 


18.1 


1.7 


13.6 


1.6 


26.5 


2.5 


PV 


Hi^ 


25.1 


2.9 


27.1 


2.9 


50.0 


2.6 




Low 


10.2 


1.8 


18.7 


2.2 


18.9 


2.0 




Range 


IU.9 


1.1 


8.4 


0.7 


11.1 


0.6 


LE 


Hi€^ 


28.0 


5.1 


27.6 


5.0 


53.2 


2.8 




Low 


12.8 


2.0 


17.7 


2.1 


17.0 






Range 


15.2 


1.1 


9.9 


0.9 


18.2 


0.9 


LE-AV 


Hi^ 


25.6 


2.8 


24.7 


2.7 


28.2 


2.4 




Low 


11.8 




18.0 


2.1 


14.7 


1.8 




Range 


11.8 


0.9 


6.7 


0.6 


15.5 


0.6 



Table 5*1^ 



Range of Class Means and Grade Equivalents for MAT Posttests 
Adjusted by First Grade Pretests, CRAFT 2 
(Class As Unit) 



Method 




Word Knowl* 


Word Discrim. 


Reading 


Mean 




Mean 




Mean 


G«£« 


BR 


Hie^ 


42*0 




37.0 


4.9+ 


62.0 


4.9+ 




Low 




1.8 


14.1 


1.8 


10^ 


1.7 




Range 


32.2 


3.1 


22.9 


3.1 


51.1 


3.2 


PV 


Hi^ 


32.7 


5.9 


50.9 


5.6 


57.6 


3.2 




Low 


2.6 


1.2 


15.6 


hi 


15.1 


1.8 




Range 


50.1 


2.7 


15.5 


1.7 


22.5 


1.4 


LE 


Hi^ 


55.5 


i«-.9+ 


31.6 


5.9 


44.3 


4.0 




Low 




1.7 


XM 


ifQ 


11.2 


1.7 




Range 


28.0 


3.2 


17.7 


2.1 


33.1 


2.5 


LE-AV 


Hi^ 


25.9 


2.9 


26.3 


2.8 


29.7 


2.6 




Low 




hi 


14.0 


1.8 


6.3 


1.5 




Range 


20.5 


1.4 


12.3 


1.0 


23.4 


1.1 



ssssai 



Table 5.J.5 

Range of Class Means and Grade Equivalents 
for mT Posttests Adjusted by First Grade Posttests, CRAFT 2 

^Class as Unxt) 



Method 


Word Khovl. 


Word Discrim. 


Reading 


Mean 


G«E« 


Mean 




Mean 


G«E« 


BR 


High 3‘^.9 


4.6 


50.6 


5.6 


52.8 


4.9+ 




Low 


1.8 


12.6 


1.7 


12.5 


1^7 




Range 2^.6 


2.8 


18.0 


1.9 


40.5 


5.2 


PV 


EL^ 52.2 


5.7 


50.7 


5.6 


56.5 


5.1 




Low 5.5 


1.6 


17.8 


2.1 


-12:5 


-1:2 




Range 26.7 


2.1 


12.9 




21.0 


1.2 


LE 


High 52.8 


5.7 


28.9 


5.2 


40.9 


5.4 




Low 9«8 


1.8 


15.2 


-1:2 


15.8 


1.8 




Range 25.0 


1.9 


15.7 


1*5 


27.1 


1.6 


LE-AV 


High 28.4 


5.1 


26.0 


2.8 


51.8 


2.7 


V. 


Low 8.1 . 


1.7 


. 15.5 


1.7 


10.9 


1.7 




Range 20*5 


1.4 


3^.7. 


1.1 


20.9 


1.0 
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Table 5 



Analysis of Variance: Comparison of Approaches for 

MAT Word Discrimination Adjusted by First-Grade Pretests, CRAFT 2 

(Class as Unit) 



Source 


SS 


df 


MS 


F 


Between Approaches 
Within Approaches 
Total 


44.029 

1514.615 

1558.644 


1 

56 

Jl 


44.029 

56.517 


1.205 



Table 5*17 

Analysis of Variance: Congaarison of Approaches for 

MAT Word Discrimination Adjusted by FirsVGrade 
Pretests Controlling for School Effects, CRAFT 2 

(Class as Unit) 



Source 



SS df MS F 



Between Schools 



424.995 10 



^lit Session 

Non- split Session 

Between Approaches within 
Schools 

Within Approaches and 
Schools 



64.558 




2 


252.177 




9 




516.715 


11 




61S.951 


. 16 



52.269 <1 

28.019 <1 



58.558 



y 



7 



Total 



1558.6 J 9 



Table 5-lC 



Analysis of Variance: Con5)arison of Methods for 

MAT Word Discrimination Adj'usted by First-Grade Pretests, CRAFT 2 

(Class as Unit) 



Source 




SS 




df 


1-lS 


F 


Betv/een Schools 








10 


• • 




PV vs. LE-AV 












' • 


Split-Session 


64.558 




2 




32.269 


<1 


Non-split Session 


59.575 




1 




59.575 


1.545 


PV vs. LE 


104.'l8 




3 




34.775 


<1 


BR vs. LE 


67.067 




3 




22.556 


<1 


BR vs. LE-AV 


21.217 




2 




10.603 


. <1 


Between Methods within 
Schools 




?i 6.715 




11 






Within Methods and 
Schools 




616.951 




16 


58.556 




Total 




1558.639 




37 
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Table 3*19 



Analysis of Variance: Comparison of Approaches for MAT Word 

Discrimination Adjusted by First-Grade Pretests, CRAFT 2 
(Split Session Schools Deleted) 

(class as Unit) 



Source 


ss 


df 


MS 


F 


Between Approaches 


m.062 


1 


m.o6s 


2.935 


Within Approaches 


1155.956 


50 


57.864 




Total 


1246.998 


51 








Table 5 *20 




' 



Analysis of Variance: Comparison of Approaches for MAT Word 

Discrimination Adjusted by First-Grade Pretests 
Controlling for School Effects, CRAFT 2 
(^lit Session Schools Deleted) 

(Class as Unit) 



Source 


SS 


df 


MS 


F 


Between Sdtiools 


589.427 


8 






Between Approaches 
within Sdiools 


252.177 


9 


28.020 


<1 


Within Approaches 
and Schools 


605.594 


14 


45.242 




Total 


1246.990 


51 
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Table 5.21 



Analysis of Variance: Cooiparison of Methods for 

MAT Word Discriirdnation Adjusted by First Grade-Pretests, CRAFT 2 

(Split Session Schools Deleted) 

(Class as Unit) 



Source 




SS df 


MS 


F 


Between Schools 




389.427 8 






PV vs. LE-AV 


59.575 


1 


59.575 


1.378 


PV vs. LE 


104.318 


3 


5'^.775 


<1 


BR vs. LE 


67.067 


3 


22.356 


<1 


BR vs. LE-AV 


21.217 


2 


10.608 


<1 



Between Methods within 

Schools 252.177 9 

Within Methods and 

Schools 605.594 l4 43 .242 

1246.998 51 



Total 



Table $.22 




All Methods 4.09 5.88 1.09 1-98 5.25 .54 2.88 



San Diego Pupil Attitude Inventory, CRAFT 2 

(Child as Unit) 



Method and Approach 


N 


Mean 


S.D. 


SC Approach 
BR 


156 


18.35 


3.87 


PV 


190 


18.97 


5.59 


Total 


M 


18.69 


5.75 


LE Approach 
Lfi 


152 


19.09 


3.97 


LE-AV 


i 4 o 


18.94 


3.45 


Total 


272 


19.01 


5.72 


All Methods 


618 


18.83 


3.75 



■ 




Table 


5.24 








Con5>arison of Suhsample Children 
to the Entire Population on the MAT Posttests, 


CRAFT 2 


MAT 

Suhtest 


CRAFT 


Sub 


s a m 


pie 


Mean 


S.D. 


N 


Mean 


S.D. 


N t 


Word Know 3 .edge 


18.49 


8.91:- 


629 


19.27 


8.92 


149 -1.06 


Word Discrimination 22.30 


3.76 


630 


25.29 


8.40 


149 -1.58 


Reading 


' 3 ' *7 V. 


11.57 


628 


24.79 11.81 


149 -1.11 


Spelling 


15 .6; 


9.45 


626 


16.83 


9.01 


148 -1.54 


Arithmetic 


£.11 


.63 


635 


2.16 


.59 


I2S -0.91 









MPiliiliPlili 
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Table 5*25 

Correlations between First Grade Pretests 
and Second Grade Subsan?)le Tests 
(Child as Unit) 



Posttests 


Murphy- 

Durrell Thurstone 
Learning Pattern 
Rate Copying 


Met. 
Wd. ttog. 


Readiness 
. Listen. 


Gilmore 










Accuracy 


.k^ 


.34-*** 


.25*^ 


.kx** 


Rate 


.2m 


.21*** 


.22*** 


.zy** 


Gates Wd. Pronunciation 




.32***^ 


.27**** 


.35*** 


Fry 




.2m 


.17** 


.32*** 


Writing San^le 










No. of Running Words 




.23**** 


.05 


.11 


No. of Different Words 


.59*** 


.23**** 


00 

o 

• 


. 16 * 


No. of Wds. ^ell. Correct 


• .40*** 


.24*** 


.08 


.12 


No. of Polysyllabic Words 


.53*^* 


.1^ 


.08 


.14 


Mechanics Ratio Scale 


.19» 


. 26 *** 


. 16 * 


.21** 



* P<.05 

** P<.01 



T&ble 5.26 

Obtained Results for Subsample Measures. CRAFT 2 

(caiild as Unit) 
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Table 5*29 

Grade Equivalent Means on the Gilmore Accuracy and 
Gates Word Pronunciation Tests, CRAFT 2 



Method and 


Gilmore 


Gates 




Approach 


Unadjusted 


Adjusted 


Unadjusted 


Adjusted 


SC Approach 
BR 


3.36 


T. 

3.^2 


2.97 


3.00 


PV 


3 . 7 *» 


U .09 


5.15 


3.30 


Total 


3.55 


3.76 


5.05 


5.15 


LE Approach 
LE 


5.17 


2.88 


2.97 


2.85 


LE-AV 


3 .W 


3.28 


5.03 


2.97 


Total 


3.30 


3.08 


5.00 


2.91 




K.Ol 



Table 5.51 



Analysis of Variance; Fry Test Adjusted by 
First-Grade Pretests Across All Schools, CRAFT 2 



Source 


SS 


df 


MS F 


Between Approaches 


576.096 


1 


576.096 1.984 


Within Approaches 


10455.545 


36 


390.571 


Total 


U029.4^1 


37 


.. 




Table 5.52 


- 


Analysis of Variance: Fry Test Score Adjusted 

by First-Grade Pretests Controlling for School Effects, CRAFT 2 


Source 


SS 




df MS F 


Between Schools 




407^^.722 


10 


Split Session 
Non-split Session 
Between Approaches 
within Schools 


1001.870 

1954.156 


2956.006 


2 500.955 1.99^ 

9 214.904 <1 

11 


Within Approaches 
and Schools 


- 


4018.713 


16 251.170 


Total 




11029.441 


57 



192 






UN 

I 



OI 

Eh 



O 



01 



fe| 

•P , 

ai l 4 
V «H 

»4 

•• <|> 
0 ) ^ 
u 4 h 
C ^ 
of P 

•rl 

i5 p 

> Vi 

Vi 01 

0 4 > 
. 01 

01 a> 
•H -P 

I’S 



01 

•d 

g 



5 



I 

^ CQ 

•H 

pB| 






4-1 

•O 



ca 

09 



(U 

s 

g 

CO 



s 



CVJ 

-d- 



01 

H 

I 

CO 

c 

V 

0 ) 

3 

n 



- 3 t 

^ IT\ 



lf\ CM VO 00 OI 
rr\vp ^VQ CVI 
O\o rf\iTS^ 

• • • • • 

8 C3N ITV 0> Q 
KA HOD CTk 



lf\ 



fTvH H 



rl 

rH 



CU H trvK>oi 



ON 

CVI 



g^sss 

O ^iakS 



§ 

•H 

ca 

6 01 

0 0 ) 

•H CO 

01 

09 <P 

>S ;4 

l^Sf 



n 

09 

C 

•H 






? 



S 

s 

• • • s 

???g 

gssi 

0 ) 

m 



§ 



ir\ 

cu 



'a 






VO fA rH 

8 Ei 3 



o\ 

a 

S S 



09 

H 

0 

1 

CO 

1 



£ 

•p 

£ 

a 



3 e 



H 

a 

a 



193 



Tbble ^, 3 ^ 



Analysis of Variance: Polysyllabic Word Score 
Adjusted by First-Grade Pretests Across All Schools, CRAFT 2 



Source 


SS 


df 


MS 


F 


Within Approaches 


2i|-.277 


1 


24.277 


<1 


Between Approaches 


4077.172 


'36 


113.255 




Total 


4101.449 


37 







Thble 5.35 

Analysis of Variance; Polysyllabic Word Score 
Adjusted by First-Grade Pretests Controlling for 
School Effects, CRAFT 2 



Source 


SS 


df 


MS 


F 


Between Schools 




1863.656 


10 






Split-Session 
Non-split Session 
Between Approaches 
within Schools 


405.627 

1094.680 


1498.307 


2 . 

9 

11 


201.814 

121.631 


4.366* 

2.632* 


Within Approaches 
and Schools 




759.486 


16 


46.218 




Total 




4101.449 


37 
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Table 5*37 



Conparison of Boys cufid Girls on 
MflT Baw Scores by Method^ CRAFT 2 
(Child as Unit) 



Subtest 


Method 




Boys 






Girls 




t 


Mean 


S.B. 


N 


Mean 


S.B. 


N 


Word Khowl* 


BR 


19.14 


9.19 


77 


20.01 


8.80 


. 84 


1 

. 

o\ 




PV 


17.65 


8.65 


100 


19.99 


8.96 


94 


-1.86 




LE 


17.34 


8.68 


70 


18.56 


8.85 


66 


- .67 




LB-AV 


17.83 


8.91 


70 


17.01 


9.22 


68 


.53 




Tbtal 


17.98 


8.88 


317 


19.06 


9.05 


312 


-1.45 


Word Biscrim* 


BR 


22.28 


8.60 


76 


25.16 


8.76 


85 


- .65 




PV : 


22.04 


8.74 


101 


24.95 


8.24 


95 


-2.59*^ 




LB 


21.65 


7.84 


69 


21.88 


8.56 


67 


- .16 




LE-AV 


20.90 


8.92 


71 


20.54 


9.84 


68 


.22 




T6tal 


21.76 


8.58 


317 


22.86 


8.97 


513 


-1.57 


Reading 


BR ; 


25.18 


11.75 


77 


24.58 


12.04 


84 


- .64 




PV ' 


25.25 


10.58 


99 


25.89 


11.75 


94 


rl .66 




LB 


25.05 


11.65 


70 


24.76 


11.60 


66 


- .86 




LE-AV 


25.08 


11.85 


70 


21.70 


ii. 5 i 


68 


.69 




Total 


25.14 


11.53 


516 


24.55 


11.84 


512 


-1.29 


Spelling 


BR 


15.34 


10.01 


76 


18.80 


8.55 


81 


- 2 . 53 » 




PV 


15.94 


9.54 


101 


18. 04 


9.36 


95 


- 5 . 02 » 




LB : 


15.48 


8.58 


69 


15.68 


8.85 


65 


-1.45 




LE-AV 


14.50 


9.58 


71 


14.88 


10.07 


68 






Total 


14.26 


9.44 


317 


17.05 


9.29 


309 


- 5 . 72 » 


Arithmetic 


BR 


21.47 


5.76 


76 


20.90 


5.65 


81 


.62 




PV 


20.94 


6.93 


101 


21.46 


6.15 


96 


- .55 




LE 


21.68 


5.88 


71 


22.45 


6.18 


69 


- .73 




LE-AV 


20.79 


7.22 


73 


19.24 


6.06 


68 


1.38 




Total 


21.20 


6.53 


321 


21.05 


6.11 


514 


.50 



* K.05 
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Table 5*58 



CoTiiparison of Boys and Girls on M/VT Posttests 
Adjusted by First-Grade Posttests, CRAFT 2 

(Child as Unit) 



Subtest 


Method 


Mean 


Boys 

S.D.** 


N 


Mean 


Girls 

S.D.^ 


N 


t 


Word Knowl* 


BR 


18.59 


9.19 


81 


20.44 


8.80 


85 


-1.52 




PV 


17.8? 


8.65 / 


102 


20.72 


8.96 


99 


-2.28^ 




LE 


16.89 


8.68 


74 


18.68 


8.85 


71 


-1.22 




LE-AV 


17.40 


8.91 


74 


17.05 


9.22 


70 


0.24 




Total 


17.72 


8.88 


551 


19.41 


9.05 


525 


-2.42» 


Word Discrim* 


BR 


21.15 


8.60 


81 


25.16 


8.76 


85 


-1.50 




PV 


22.67 


8.74 


102 


.26.84 


8.24 


99 


-5.47**^ 




LE 


21.72 


7.84 


74 


21.95 


8.56 


71 


-0.15 




LE-AV 


19.60 


8.92 


74 


20.11 


9.84 


70 


-0.52 




Total 


21.59 


8.58 


551 


25.56 


8.97 


525 


-2.87*^ 


Reading 


BR 


21.10 


U.75 


81 


.25.65 


12.04 


85 . 


-1.57 




PV’ 


24.10 


10.58 


102 


27.05 


11.75 


99 


—1.88 




LE 


25.20 


11.65 


74 


26.58 


11.60 


71 


-1.64 




LE-AV 


22.65 


11.85 


74 


21.55 


11.51 


70 


0.56 




Total 


22,84 


U.55 


551 


24.82 


11.84 


525 


-2.19» 


(felling 


BR 


15.89 


10.01 


81 


20.76 


8.55 


85 


-4.77** 


PV 


15.45 


9*54 


102 


19.77 


9.56 


99 


-4.72«t 




LE . 


11.94 


8.58 


74 


15.99 


8.85 


71 


-2.78^* 




LE-AV 


15.21 


9*58 


74 


15.58 


10.07 


70 


-I.45 




Total 


15.17 




351 


18.50 


9.29 


525 


-7.01** 



S.D* of raw scores 

* K.05 

** P<.01 
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Table 5*39 

Pre-First«6rade School Ebgserience, CBAFT 2 



Method 


No K^. 

or Fre-Kgn. Exp. 


21-100 
Half Days 


Pull 


tea. 


Kdfi. 


Plus 


No. 


< 


No. 


i 


No. 


i 


No. 


* 


BR 


48 


28.92 


12 


7.25 


100 


60.24 


6 




PV 


58 


29.00 


7 


3.50 


129 


64.50 


6 


5.00 


LE 


41 


28.28 


1 


.69 


98 


67.59 


5 


3.^5 


LE-AV 


27 


18.62 


8 


5.52 


108 


74.48 


2 


1.38 


Total 


174 


26.^2 


28 


4.27 


455 


66.51 


19 


2*90 
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Table 5*^1 



Grade Equivalents on Stanford Posttests of Children 
with and without Pull Kindergarten Experience^ CRAFT 2 

(Child as Unit) 



Subtests of Stanford Posttests 



Method 


Word 

Reading 


Paragraph 

Meaning 


Vocab. 


^ell. 


Wd. St 
SkiUs 


SC Approach 

BR 

with 


1.5 


1.6 


1.5 


1.6 


1.5 


without 


1.4 


1.5 


1.4 


1.6 


1.4 


PP 

with 


1.5 


1.5 


1.5 


1.5 


1.4 


without 


1.4 


1.4 


1.4 


1.5 


1.4 


Total 

with 


1.5 


1.5 


1.5 


1.6 


1.5 


without 


1.4 


1.4 


1.4 


1.6 


1.4 


LB Approach 

le 

with 


1.5 


1.5 


1.5 


1.6 


1.4 


without 


1.5 


1.4 


1.5 


1.5 


1.5 


LE-AV 

with 


1.5 


1.4 - 


1.5 


1.6 


1.5 


without 


1.4 


1.5 


1.5 


1.5 


1.5 


Total 

with 


1.5 


1.5 


1.5 


1.6 


1.4 


without 


1.5 


1.4 


1.5 


1.5 


1.5 


All Methods 
with 


1.5 


1.5 


1.5 


1.6 


1.5 


without 


1.4 


1.4 


1.4 


1.5 


1.4 
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Results of Metropolitan Fosttests for Children vith and without 
Full Kindergarten Experience, CRAFT 2 
(Child as Chit) 
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Table 5*^5 

Mean Grade Equivalents on WkH Posttests 
For Children with and without Kindergarten Experience, Craft 2 

(Child as Unit) 



Method 

and 

Approach 


Word 

Knowledge 


Word 

Discrim. 


* .A 

Beading 


Spelling^ 


f , 

SC Approach 
BH 

with 


2.6 


2.5 


■: 2.5 ' 


2.5 


without 


2.4 


2.5 


2.1 


2.4 


PV 

: with 


2.5 


2.6 


2.5 ^ 


2.4 


without 


2.4 


2.4 


2.5 

> 


2.4 


1 

Total 

with 


2.6 


2.5 


f 

2'.5 ; 


2.4 


without 

i 

« 


2.4 


2.4 


2.2 • 


2.4 


LE Approach 






i 

' ii 


"i » 

y-% '•.- •* 

* 

♦ j 


li 

< with 


2.5 


2.5 


\ 

2.4 


' • 2.5 ■ 


without 


2.5 \ 


2 . 2 : 


2.2 


2.1 


LE-AV 
: with 


2.4 


2.5 


2.5 


2.5 


without 


2.4 


2.1 


2.0 


2.2 


Total 

with 


2.4 


2.4 


2.4 


2.4 


; without 


2.5 


2.1 


2.1 


2.1 


All Methods 


with 


2.5 


2.5 


2.5 


2.4 


without 

s' 


2.4 




2.2 


2.5 



* Cil^ Norms Unavailable; State Norms Used 
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Table ^.44 



Early Readers Congpared to 

Total Population on First-Grade Pretests and Posttests, CRAFT 2 



Test Total ■; Early Readers t 

N Mean S»I)* N Mean. S.B. 



Pretests 



Murphy-Burrell 



Phonemes 


993 


9.86 


8.54 


51 


Capital Letter Names 


1,007 


11.21 


8.85 


49 


Low .Case Let. Names 


793 


8.90 


7.21 


35 


Total Letter Names 


795 


20,33 


15.44 


36 


Learning Rate 


1,064 


8.16 


4.03 


55 



Metropolitan Readiness 
Word Meaning 
Listening 

Thurstone 
Pattern Copying 
Identical Forms 

Posttests 

Stanford 
Word Reading 
Paragraph Meaning 
Vocabulary 
l^elling 

Word Study Skills 



i 

*»• K.OOl 



1,124 


$i25 


2.28 


56 


1,125 


6.79 


2.58 


56 


1,062 


2.68 


3.84 


56 


1,102 


5.36 


6.16 


56' 



1,127 


13.42 


6.38 


51 


1,111 


10.17 


7.26 


51 


1,113 


14.35 


5.4 i 


51 


1,101 


6.51 


5.62 


51 


i,iii 


25i'98 


9.05 


51 



22.95 13.27 10 . 8 ?H» 

21.82 6.24 8.5l*<» 

17.71 6.96 7*13*^ 

39.72 13.12 7.43*»* 

12.09 4.23 7.17*^ 

6.96 3.01 • 5.57*** 
8.77 2.28 : 5.71*“ 

5.95 5.01 6. 32W** 

10.71 7.23 6i44^«» 



23.02 7.43 10,64iw* 

20.21 10.64 -9.78 >h» 

19.02 6.77 6.10*«M^ 

12.96 5.75. 8.12»^ 

37.02 10.79 ’ 8.63»^ 
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' T^ble 5*^5 

Early Readers Conipared to Total Population 
in the lianguage-Ei^eri^ce Approach on First-Grade 
Pretests and Posttests, CRAFT 1 



Test 


Total 




Early Readers 


t 




N Mean 


S.D* 


N Mean 


S.D* 




Pretests 


• . 










Marphy-Durrell 

Phonemes 

Capital Letter Names 
Low* Case Let* Names 
Total Letter Names 
Learning Rate 


517 9.67 
5oe U>.99 
JK)7 8.^ 
4o7 ao.00 
521 7.95 


8.3i 

8.76 

7.42 

15.56 

4.00 


25 21.57 
22 20.91 
14 17.43 
14 59.00 
24 11.96 


10.9*^ 

7*15 

7.16 

14.27 

5.68 


6.72«» 

5.19**“ 

k.ift* 

4.4o«» 

4.83*** 


Metropolitan Readiness 
V6rd Meaning 
Listening 


559 5.35 
559 6.T1 


2.52 

2.66 


^ 8.00 
24 9.59 


2*90 

2.17 


5.4^ 

4.84*** 


Tfaurstone 
pattern Copying 
Identical Foxms 


528 2.85 
556 5.66 


4.X3 

6.29 


24 6.67 

25 10.88 


5.20 

6.55 


4.44**» 

4.06*** 


Posttests 












Stanford 
Word Reading 
Paragraph Meaning 
Tocahulary 
Spelling 

Word Study Skills 


559 12.36 
551 8.94 
557 13.87 
547 5.86 
553 24.73 


6.01 

6.59 

5.44 

5.36 

8.93 


20 23.75 
20 17.85 
20 18.85 
20 11.70 
20 39.25 


6.96 

10.78 

7.04 

6.21 

8.26 


8.26*** 

5.8^ 

3.991HW 

k.T&t** 

7.09*** 



P<.01 
*** P<.001 



Table 5*^6 



Early Readers Cooqpared to Total Population 
in the Skills-Centered Approach on First-Grade 
Pretests and Posttests, CRAFT 1 



Test Total Early Readers t 

N Mean G*D. N Mean S.D. * 



24.04 14.82 8,2T««^ 
22.56 5.27 6.55**^ 



Pretests 

Mmphy-Ourrell 

Phonemes 

Capital Iietter Names 
Low. Case Let. Names 
Total Letter Names 
Learning Rate 

Metropolitan Readiness 
Word Meaning 
Listening 

Thurstone 

Pattern Copying 
identical Forms 



476 10.07 8.78 28 
505 11.45 8.94 27 
586 8.96 6.99 21 

588 20.68 15.30 22 
545 8.39 4.04 31 



565 5.15 2.23 52 

566 6.87 2.50 32 



54 o 2.52 3^54 32 

566 5.07 6.03 31 



17.90 6.82 5»72«» 

40.18 12.31 5-84**» 

12.19 4.60 5.18^w* 

6.19 2.86 2.6o» 
8.31 2.24 5.21*» 

5.41 4.80 4.55^ 
10.58 7.74 5.01^”** 



Posttests 

Stanford 
Word Reading 
Paragraph Meaning 
Vocabulary 
Spelling 

Word Study Skills 



568 


14.46 


6.56 


51 


560 


11.59 


7.68 


51 


556 


14.84 


5.54 


31 


55*» 


7.16 


5.81 


31 


558 


27.22 


9.00 


51 



22.55 7.68 6.76*** 
21.74 10.27 7.30*^ 

19.15 6.59 4.40«Ht 

13.77 5.27 6.24*** 
35.58 XI.92 5.09*^ 



* P<.05 

p<.01 

p<.ooi 



Table 5-^7 



Comparison of Early Readers in the Two Approaches 
on. First-Grade Pretests and Posttests> CRAFT 1 



Test . 


SC 


Approach 


LE 


Approach 


t 


** 1 * . . 

f * * 


N 


Mean 


S.D. 


N 


Mean S.D. 




.»♦ • • i . t • •» 

Pretests 










V • . ^ m r T . 




Murphy-Rurrell 
rPhoneiieff ... 


28 


2l^.04 


,14.82 


25 


21.57 10^94 




. Capital Letter fiefs' 


27 


22.56 


5.^ 


22 . 


20.91 7-16 


;88 


Low. Case Let. Raimes 


.21 


i7.90 


: 6.82 


14 \ 


17.45 7-l6 




,,.Tbtel Letter Itoss . . 


22 


40.l8 


12.51 


14 


. 39-00 14.27 


. 

:.25 


Learning Rate 

• fir % ' • 


51 


12.19 

* 


4.66 


24 


11.96 5.68 


, .20 


Thurstone 
Pattern- Copying 


52 


5.^1 


4.80 


24 * 


. • ■ - ' 

6.67 5.20 


- >91 


' identical Forms 


51 


10.58 ^ 


7.74 


25 


10.88 6.55 


- .15 


Metropolitan Readiness 
. Word Meaning . 


52 


6.19 


2.86 ’ 


24 


6.0b’ 2.90 


• *\ U * 

• t 

-^29» 


Listening 


52 


8.51 


2.24 


24 


9-59 2.17 


-1.79 


Detroit Word Recognition 
Word Recognition 23 


5.08 


8.36 


l4 


8.36 6.27 


-1.36 

f . . . 


4 

- . ♦ % 

Posttests 










■ . . .. 




Stanford . 

. Word Reading . 


51 


22.55 


7.68 


20 


23.75 6.96 


-> * 

■ - .:»56 


paragraph Meaning 


51 


2i.7'» 


10.27 


20 


17.85 10.78 


1.25 


Vocabulary 

, ♦ ..... .. . 


51 


19.13 


6.59 


20 


18.85 7-04 


.14 


Spelling 


51 


15.77 


5.27 


20 


ii.70 6.21 


i.^ 


Word Study Skills 


51 


55.58 


U«92 


20 


39.25 8;26 

.1 


-1.27 

V 



* P<.05 
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Table 5-^8 



Mean Grade Equivalents for Early Readers and 
Total Population on First-Grade Stanford Posttest > CRAFT 1 



Stanford Subtest 


Total 


Early Readers 


Word Reading 


l.k 


1.9 


Paragraph Meaning 


1.5 


1.7 


Vocabulary 


1.4 


1.8 


Spelling 


1.6 


2.0 


Word Study Skills 


1.4 


1.9 



Table 5 .49 

Mean Grade Equivalents for Early Reefers on 
First-Grade Stanford PoSttest by Approach^ CRAFT 1 


Stanford Subtest 


SC Approach LE Approach 


Word Reading 


1.9 


1.9 


Paragraph Meaning 


1.8 


1.7 


Vocabulary 


1.8 


1.8 


l^elling 


2.1 


1.9 


Word Study Skills 


1.9 


2.0 



Table 5* *50 



Comparison oi Early Readers in ;bhe Two Approaches 
on Second-Grade Metropolitan Achievement Tests, CRAFT 2 



.Test . SC Approach , LE Approach t 

N Mean S.D. N Mean S.D. 



October Tests 



Word Kiowledge®'^^ 


17 


2 M 


Readiiig^^^ 


17 


2.51 


April Tests 






Word Khowledge 


17 


27.12 


Word Biscrimination 


17 


50.18 


Reading 


17 


55.06 


Spelling 


17 


24.55 


Arithmetic® 


35 


2.55 



.55 


15 


2.45 


' .52 


- *.06 


.76 


15 


2.10 

. . • N 


.55 


i;72 


8.76 


16 


26.44 


6.86 


.24 


6.06 


16 


29.56 


5.89 


.29 


12.51 


16 


55.19 


10.10 


- .55 


5.82 


35 


25.94 


6.58 


.19 


.47 


14 


2.62 


..49 


- .49 



These were . the only subtests, administered in October 
^ Grade Equivalents sinpe no raw scores were available 

* K.05 
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Table 3»30k 



Comparison of Early Readers and Total Population on 
Second-Grcide Metropolitan Achievement Tests , 

CRAFT 2 



Tests 


Tbtal CRAFT 


Early Reader 


October Tests 






Word Knowledge 


1.7 


2.4 


Reading 


1.7 


2.3 


April Tests 






Word Knowledge 


2.4 


3.2 


Word Discrimination 


2.4 


3.5 


Reading 


2.5 


2.9 


Spelling^ 


2.4- 


3.6 


Arithmetic 


2.1 


2.6 



* From National Norms 
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Table 5*51 

Mean Grade Equivalents for Early Readers on 
Second-Grade Metro(politan Achievement Tests by- Approach, CRAFT 2 



Test 


SC Approach 


, LE Approach 


October Tests 






Word Khowledge^^^ 


2.44 




a«b 

Reading ^ 


2.5 




Anril Tests 




f ^ 


Word Khowledge 


5.2 


5.1 


Word Discrimination 


5.5 


5.5 r ; ; : • ■ 


Reading . 


2.8 


2.9 ' ' 


Spelling ' 


5.6 


V..-. 


Arithmetic'^ 


2.5 


2.6 

* » . ■ 



^ These were the only subtests administered in October .. 

•u 

Grade equivalents since no raw scores were available -- 
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Table 5*52 



Early Headers Coin|)ared to Total CHAFT Population 
on Second-Grade MAT Posttests 



Test 


Total 


Early Headers t 




N Mean S.D* 


N H6&I1 S«D« 



Total Population 



Word Khowledge 


629 


18.49 


8.94 


55 


26.79 


7.90 


5 . 25 <h» 


Word Discrimination 


650 


22.50 


8.75 


55 


29.68 


5.99 


4 .g 0 »* 


Heading 


628 


25.75 


U.57 


55 


3^.09 


11.54 


5 . 07 '”** 


l^elling 


626 


15.65 


9.^5 


55 


24.15 


6.10 


5.10W* 


Arithmetic 


655 


2 *U 


.65 




2.57 


.48 


5 . 94 <»* 


SC Approach 


Word I&iovledge 


555 


19.15 


8.92 


17 


27.12 


8.76 


5 * 57 «^ 


Word Discrimination 


555 


25.15 


8.65 


17 


30.IS 


6.06 


5 * 27 *» 


Reading 


55 ^ 


24.20 


11.48 


17 


55.06 


12.51 


5 . 09 »» 


^eUing 


555 


16.46 


9.52 


17 


24.55 


5*82 


5 . 52 »* 


Aritlmetic 


55 ^ 


21.18 


6.18 


16 


25.51 


4.70 


2.57* 


liE Approach 


Word Khowledge 


27 ^^ 


17.65 


8.90 


16 


26.44 


6.86 


3 . 89 *» 


Word Discrimination 


275 


21.24 


8.80 


16 


29.56 


5.89 


3 . 66 ** 


Heading 


274 


25.15 


11.65 


16 


35.19 


10.10 


4 . 01 ** 


Spelling 


275 


14.56 


9.24 


16 


23.94 


6.58 


3 . 93 *» 


Arithmetic 


281 


2.11 


.65 


14 


2.62 


.49 


2.8^ 



Grade eqtdvalents 
* P <.05 

K.01 
p<.001 
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Table 5*55 

Mean Daily Time in Minutes for 
Reading Activities and Supportive Activities, CRAFT 2 

(class as Unit) 



Method and 
Approach 

W. ■ ’ ' . ■ A 


Reading Time 
Mean ; S.Di 


Supportive Time 
Mean S.D. 


Total Time 
Mean S.D. 


iSC Approach 














BR 


108.40 


18 .If 2 


55.10 


21.80 


165.50 


54.45 


TV 


162.50 


12.36 


59.50 


17.57 


162.00 . 


26 . 49 ‘ 1 . 


Total 


.105 . '‘5 


15.^ 


57.30 


19.^ 


162.75 


29617 • 

- ^ * 


LB Approach 




- 










LE , ; 


99 . 00 ' 


10.86 v; 


106.88 


18.38 


205.88 


Ilf. 96 


IB-AV 


92.00 


14 . 67 : ; 


91.88 


Ilf ,79 


185.88 


17.76 


Total 


95.50 


15;57 


99.38 


18.29 


194.88 


18.96 


All Methods 


100.75 


15.09 


77.23 


28.19 


177996 


29.58 



Mean Ninutea Per Say aipent on Specific Reading and 8^pportive Actlvltiea, CRAFT 2 

(Claaa aa unit) 




Table 5.55 

Correlatione of 75 Variables vith MdT Adjusted Class Means, CItAFT 2 



Variable Adjusted by Pretests Adjusted by Posttests 







WK« 


WD 


Rdg 


Sp 


WK. 


WD 


Rdg 


Sp 


1 


Median ^rs* Edne. in oommm* 


-09 


. 10 


-07 


02 


-l4 


08 


-10 


-03 


2 


Median ixiccsae in ccamamity 


03 


20 


o6 


08 


02 


24 


06 


08 


5 


Teacher's Age 


18 


10 


07 


-02 


26 


22 


14 


06 


k 


Teadier's Education^ Level 


-13 


01 


03 


-13 


-14 


06 


07 


-14 


5 


Type Teadiing Certificate 


05 


-12 


03 


-17 


05 


-14 


04 


-21 


5 


Total No. Trs* Teach. 


16 


03 


19 


-09 


21 


08 


25 


-07 


7 


Total Trs. 6r. 2 Teach. Bip. 


27 


02 


23 


-05 


29 


01 


25 


-08 


8 


Marital Status 


15 


-51 


-06 


-31 


-06 


-21 


05 


-26 


9 


Rusher of Children 


-08 


-01 


02 


-02 


00 


11 


14 


08 


10 


Teacher Absence 


-42* 


-36* 


-36* 


-40* 


-38* 


-29 


-33*. 


-36* 


u 


Teadher Fre. S-D: Basie 


21 


11 


11 


09 


12 


-03 


00 


03 


12 


" Fre. S-D; Sadiv. 


02 


-20 


-07 


-06 


06 


-20 


-o6 


-04 


15 


" Fre. S-D; LB 


00 


-05 


-04 


06 


03 


-03 . 


-02 


12 


l4 


" Post. S-D; Basie 


10 


14 


03 


06 


01 


04 


-09 


-03 


15 


" ; Post. S-D; Indiv. 


08 


-05 


06 


00 


11 


-05 


08 


01 


16 


** Post. S-D; LE 


-03 


-14 


-01 


-04 


-01 


-17 


01 


-05 


17 


OScAR Qq>irieal LE 


25 


18 


. 33* 


17 


27 


17 


30* 


19 


18 


It ' II g0 


-10 


-10 


-28 


-04 


-11. 


WlO 


-33* 


-03 


19 


" ^ LE Ri^ AV 


-26 


-31 


-19 


-24 


-20 


-24 


-12 


-l8 


20 


" " LE Low AV 


-16 


-15 


-06 


-20 


-13 


-10 


-01 


-21 


21 


ft 01 


03 


10 


05 


04 


-01 


07 


02 


00 


22 


" " BR 


01 


-07 


-15 


03 


-03 = 


-16 


-24 


-02 


23 


A Priori LE 


14 


-05 


23 


-05 


l4 


-07 , 


26 


-08 


24 


" SC 


-03 


-01 


-23 


05 


-03 


-02 


-29 


05 


25 


" Ccmtrol 


-22 


— o8 


-22 


00 




-12 


-28 


-01 


26 


Pos. Motiv. Climate 


-23 


-28 


-15 


-26 


-17 


-20 


-07 


-21 


27 


Reg. Motiv. Climate 


-26 


-24 


-36* 


-12 


-26 


-23 


-40* 


-09 


28 


OScAR Total mterebanges 


-01 


-05 


-01 


-01 


-03 


-09 


-03 


-02 


29 


" Meaningful Interchanges 


-04 


-14 


-18 


-07 


-01 


-14 


-18 


-07 


50 


Mean Log Time All Activities 


-21 


-27 


-17 


-21 


-19 


-26 


-15 


-22 


51 


Rdg. • " 


07 


07 


04 


18 


-01 


00 


-03 


16 


52 


Supp. " 


-24 


-30 


-20 


-32* 


-19 


-26 


-14 


-32* 


55 


« « '• br 


13 


21 


10 


23 


05 


13 


00 


19 


54 


" " « aqp. Chart 


-U 


-U 


-04 


-02 


-13 


-16 


-03 


-06 


55 


Indiv. Rdg. 


-l6 


-22 


-l6 


-19 


-12 


-17 


-13 


-18 


36 


" " " Sisd»t Words 


02 


-23 


-11 


-13 


09 


-19 


-07 


— o8 



® WK * Word Knowledge 
WD • Word Discriiaination 
^ Decimal points omitted 



Rdg = Reading 
^ s Spelling 

21k 




Table 5 •55 cont 



Variable Adjusted by Pretests Adjusted by Posttests 







WK 


WD 


Rdg 


Sp 


WK 


WD 


Rdg 


Sp 


37 


Mean Log Tine Itaonic Activity 


-15 


-02 


-13 


-12 


-13 


04 


-11 


-08 


38 


" " " Other Rdg " 


28 


16 


32* 


25 


29 


13 


36 * 


25 


39 


" " " Listen.to Stories 


-37* 


■ - 43 * 


-33* 


- 47 * 


-35* 


-38* 


-30 


- 49 * 


4o 


" " " " « Poetry 


-08 


-16 


03 


-21 


-07 


-16 


06 


-25 


4l 


" " " Discussion 


-30 


-16 


-18 


-19 


-30 


-10 


-17 


-17 


k2 


" " " writing 


-17 


-19 


-23 


-29 


-11 


-11 




-29 


43 


" " " Audio-Visual Act. 


-15 


-24 


-14 


-14 


-07 


-19 


-05 


— 08 


44 


" " " AV vith Discussion-02 


— 08 


01 


06 


00 


-12 


03 


08 


45 


” " ” Draaatisation 


-01 


-11 


04 


-05 


-06 


-22 


' ^ 


-14 


46 


" " " Art Wbrk with Rdg 


-17 


-16 


-16 


-24 


-14 


-10 


-14 


-25 


47 


” ” ” Other Lang. Arts 


01 


-11 


04 


-11 


06 


-10 


10 


-11 


48 


” ” ” Social Studies 


-01 


24 


07 


20 




24 


03 


21 


49 


" " " Science 


-01 


20 


05 


19 


-07 


19 


00 


19 


50 


Teadher Cknpetence 


18 


10 


27 


12 


16 


06 


28 


10 


51 


Child's Chronological Age 


00 


-11 


-11 


-14 


08 


-02 


-04 


-O 6 


52 


Grade 1 Pupil Absence 


-I 6 


-11 


-23 


-14 


-12 


-04 


-22 


-08 


53 


NiT 16/65 WK (GE) 


73* 


74 * 


81 * 


76 * 


56 * 


50* 


67 * 


60 * 


54 


HiT 10/65 Reading (GE) 


71* 


69 * 


75* 


70* 


5 ^ 


51 * 


64* 


58 * 


55 


Grade 2 Pupil Absence 


07 


20 


03 


29 


65 


20 


-01 


33* 


56 


Aq>il San Diego 


47 * 


19 


40* 


25 


52* 


19 


if6* 


,29 


57 


Ho. Books Read Coaqpletely 


32* 


25 


37* 


29 


30 


18 


37* 


24 


58 


Ho. Books Read Partially 


-21 


-10 


-21 


-15 


-27 


-14 


-30 


-22 


59 


Eagerness to Read 


32* 


37* 


32* 


35* 


25 


29 


25 


28 


6o 


Maturity of Choices 


26 


39* ; 


33* 


40* 


15 


27 


25 


30 


6l 


Grade 1 Class Size - 5/1/65 


-23 


-10 


-27 


-24 


-23 


-05 


-27 




62 


Grade 2 Class Size - 3/15/66 


-13 


-09 


-04 


-13 


-13 


-04 


-05 


-11 


63 


i CRAFT Children in Class 


10 


14 


17 


14 




07 


16 


10 


64 


TeaCher-Pupil Sindlarity 


-01 


-03 


02 


-01 


05 


08 


09 


08 ' 


65 


CRAFT Teacher Attitude 


18 


36 * 


32* 


31 


07 


24 


25 


18 


66 


4/66 MAT WK) Adjusted 


100 


76 * 


85 * 


76 * 


95* 


63* 


80 * 


70* 


67 


4/66 H^T WD) by 


76 * 


100 


79* 


89 * 


64* 


90 * 


70 * 


84* 


68 


4/66 MAT Rdg| Pyetest 


85 * 


79* 


100 


79* 


. 74 * 


61 * 


95* 


68* 


69 


4/66 MAT Sp)^ Grade 1 


76 * 


89 * 


79* 


100 


^2* 


72* 


67 * 


94 * 


70 


4/66 MAT WK) Adjusted 


95* 


64* 


74 * 


62 * 


100 


64* 


77* 


66* 


71 


4/66 MAT Wd)% by 


63 * 


90 * 


61 * 


72* 


64*' 


100 


64* 


80* 


72 


4/66 MAT Rdg) PDsttest 


80 * 


70* 


95* 


67 * 


77* 


64* 


100 


65 * 


73 


4/66 MAT Sp)^ Grade 1 


70* 


84* 


68* 


94 * 


66* 


80 * 


65 * 


100 



* K.05 
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Table 5*56 

Mean Minutes Per Day Spent fc^ 

Reading Activities Correlated with the MAT Subtests , CRAFT 2 



Method and Approach 




r with MAT 






Word Khowl. 


Word Discrim. 


Reading 


Sipell. 


SC Approach 




•• 






BR 


Reading time 


.01 


- .54. 


.05 


- .05 


Supportime time 


- .25. 


- .50 


- .15 


- .20 


Total time 


- .19 


- .45 


- .08 


- .17 


Reading time 


- .07 


- .09 


- .66* 


- .22 


^pportive time 


.22 


.05 


- .42 


.08 


Total time 


.12 


.00 


- .57 


- .04 


. Total 

Reading time 


- .01 


- .50 


- .57 


- .08 


Supportive time 


- .06 


- .15 


- .19 


- .11 


Total time 


- .07 


- .29 


- .22 


“ .11 


LB Approach 
LB 

Reading time 


.15 


.15 


.12 


.55 


Supportive time 


- .59 


- .54 


- .50 


- .69* 


Total time 


- .64 


- .56 


- .55 


- .45 


LB-AV 


Reading time 


- .25 


•26 


.06 


.24 


Supportive time 


.12 


.45 


.55 


.25 


Total time 


- .10 


.58 


.54 


.59 


Total 

Reading time 


- .07 


.26 


.12 


.52 
_ ^ 


Supportive time 


- .26 


- .02 


- .10 


- 


Total time 


ON 

<M 

. 

1 


.16 


- .02 


* 


All Methods 


Reading time 


.01 


.01 


- .05 


.lb 


Supportive time 


- .19 


- .26 


- .14 


- .52 


Total time 


- .19 


- .25 


- .15 


- .22 



® MAT Subtest scores are adjusted by Grade 1 posttests 
* P<.05 
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Tt ble 5«60 



. Cooipftrisons between Methods on OScAR R Scales, CRAFT 2 



OGcAR R Scale 


Mean^ 




Mean^ 


S«D«2 


t 


Etapirical SC 




BR 


LB-AV 




4.50 


2.71 

jUK 


.22 

LE 


.44 






4.50 


2.71 

BR 


.66 

PV 


.70 


4.10»* 




4.50 


2.71 

PV 


1.20 .91 

LB-AV 


5.46«h» 




1.20 


.91 


.22 


.44 


2.88» 


Bqs^ical LB AV 


LE'AV 


LB 






3.88 


2.31 


.66 


.86 


3.7tf» 


Qnpirical BR 




BR 


PV 






6.20 


5.45 


1.80 


1.39 


5.55*» 


A Priori LB 




LE 


PV 






5.22 


2.10 


.70 

BR 


.9^ 


3.13** 




5.22 


2.10 


1.10 


1.52 


2.36* 


A' Priori SC 




BR 


LE 






5.50 


5.17 

BR 


1.22 1.30 

LE-AV 


3.71*» 




5.50 


3.17 

BR 


1.66 

PV 


2.34 


2.86* 




5.50 


5.17 

PV 


2.80 

LE 


1.39 


2.34*. 




2.80 


1.39 


1.22 


1.30 


2.42* 


Control 




BR 


LE 






16.50 


5.92 

BR 


7.55 

LE-AV 


2.78 






16.50 


5.92 

PV 


10.00 

LE 


5.19 


2.34* 




15.90 


4.86 


7.55 


2.78 


5.35«* 


Neg* Motiv* Climate 




BR 


LB 






5.90 


4.58 

PV 


1.77 

LE 


1.56 


2.54* 




4.10 


1.52 


1.77 


1.56 


5.n*» 


^ Meaningful Interchanges 




BR 


PV 






75.70 


11.88 


57.50 


18.00 


2.55* 









Table 5*62 



t Cooqparisons of Second-Grade Teachers on 
*‘the San Diego Pretests and Posttests, 

CRAFT 2 



Method and Scale 


N 


Pretest 
Mean S*D* 


]p0S^*k6S*t 
Mean S.D. 




BR 














Basic 


10 


45.10 


2.76 


45.10 


'4.45 


0.00 


Individualized 


10 


40.50 


7.10 


55*50 


7.46 


2.27* 


Lang*-E]qp* 


10 


59*00 


6.84 


51*80 


8.54 


2.42» 


PV 








‘ 


• 




Basic 


10 


42.00 


5*51 


46.30 


5.05 


-2.21* 


Ihdividualized 


10 


56.40 


5*16 


55.50 


6.09 


1.67 


Lang*-Exp* 


10 


54.00 


5.24 


29.10 


6.74 


5.81** 


LE 














Basic 


9 


44.55 


4.09 


54.22 


2.86 


6.21** 


Individualized 


9 


57*44 


5.64 


45.88 


6.79 


-2.55»* 


Lang.-Exp* 


9 


57*11 


5*25 


44.22 


^.75 


-5.1C^ 


LB-AV 














Basic 


9 


58.88 


5.51 


55*55 


7.58 


1.61 


Individualized 


9 


45. U 


4.19 


47.00 


5.00 


-2.56* 


Lang*-£xp* 


9 


42.77 


8.96 


47.00 


4.71 


-1.40 



* P<.05 

K.oi 
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